[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:23:36 dist-test-slave-gjrz krb5kdc[30798](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:23:36 dist-test-slave-gjrz krb5kdc[30798](info): set up 2 sockets
Aug 12 06:23:36 dist-test-slave-gjrz krb5kdc[30798](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 06:23:37.764499 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:23:37 dist-test-slave-gjrz krb5kdc[30798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:23:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:23:37.875492 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:45339
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:45339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:37.954293 30820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:37.954481 30820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:37.954509 30820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:37.955632 30820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:37.955669 30820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:37.955688 30820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:37.955704 30820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:37.955721 30820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:23:37.957224 30820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:45339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:45339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:37.957450 30820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:37.957646 30820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:37.962405 30839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:37.962414 30835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:37.962369 30832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:37.962445 30820 server_base.cc:1034] running on GCE node
I20260812 06:23:37.962869 30820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:37.963121 30820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:37.964265 30820 hybrid_clock.cc:648] HybridClock initialized: now 1786515817964248 us; error 33 us; skew 500 ppm
Aug 12 06:23:37 dist-test-slave-gjrz krb5kdc[30798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515817, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:37.966528 30820 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:23:37.966934 30820 webserver.cc:460] Webserver started at http://127.30.15.126:43891/ using document root <none> and password file <none>
I20260812 06:23:37.967118 30820 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:37.967164 30820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:37.967312 30820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:37.968276 30820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "4564fb22046040fd97d38dc509f0d6db"
format_stamp: "Formatted at 2026-08-12 06:23:37 on dist-test-slave-gjrz"
server_key: "fb0559cfc9671da64e8d66d0176eaf65"
server_key_iv: "c2eea6cf75cd3b34696ae3bee0629828"
server_key_version: "encryptionkey@0"
I20260812 06:23:37.968605 30820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "4564fb22046040fd97d38dc509f0d6db"
format_stamp: "Formatted at 2026-08-12 06:23:37 on dist-test-slave-gjrz"
server_key: "fb0559cfc9671da64e8d66d0176eaf65"
server_key_iv: "c2eea6cf75cd3b34696ae3bee0629828"
server_key_version: "encryptionkey@0"
I20260812 06:23:37.969820 30820 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:23:37.970439 30848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:37.970598 30820 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:37.970678 30820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "4564fb22046040fd97d38dc509f0d6db"
format_stamp: "Formatted at 2026-08-12 06:23:37 on dist-test-slave-gjrz"
server_key: "fb0559cfc9671da64e8d66d0176eaf65"
server_key_iv: "c2eea6cf75cd3b34696ae3bee0629828"
server_key_version: "encryptionkey@0"
I20260812 06:23:37.970738 30820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:37.993301 30820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:37.994992 30820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:37.995113 30820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:37.998850 30820 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:45339
I20260812 06:23:37.998884 30948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:45339 every 8 connection(s)
I20260812 06:23:37.999178 30820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:37.999544 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 30820
I20260812 06:23:37.999631 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:38.000013 30950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:38.000244 30781 external_mini_cluster.cc:1428] Setting key d12f73e5e34d378c64a74cfa3d44854f
I20260812 06:23:38.002401 30950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db: Bootstrap starting.
I20260812 06:23:38.002951 30950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:38.003214 30950 log.cc:824] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:38.003829 30950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db: No bootstrap required, opened a new log
I20260812 06:23:38.005524 30950 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4564fb22046040fd97d38dc509f0d6db" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45339 } }
I20260812 06:23:38.005645 30950 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:38.005676 30950 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4564fb22046040fd97d38dc509f0d6db, State: Initialized, Role: FOLLOWER
I20260812 06:23:38.005795 30950 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4564fb22046040fd97d38dc509f0d6db" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45339 } }
I20260812 06:23:38.005864 30950 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:38.005895 30950 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:38.005946 30950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:38.006567 30950 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4564fb22046040fd97d38dc509f0d6db" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45339 } }
I20260812 06:23:38.006680 30950 leader_election.cc:302] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4564fb22046040fd97d38dc509f0d6db; no voters:
I20260812 06:23:38.006835 30950 leader_election.cc:288] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:38.006877 30963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:38.007061 30963 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [term 1 LEADER]: Becoming Leader. State: Replica: 4564fb22046040fd97d38dc509f0d6db, State: Running, Role: LEADER
I20260812 06:23:38.007068 30950 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:38.007210 30963 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4564fb22046040fd97d38dc509f0d6db" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45339 } }
I20260812 06:23:38.007581 30964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4564fb22046040fd97d38dc509f0d6db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4564fb22046040fd97d38dc509f0d6db" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45339 } } }
I20260812 06:23:38.007652 30964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:38.007862 30965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4564fb22046040fd97d38dc509f0d6db. Latest consensus state: current_term: 1 leader_uuid: "4564fb22046040fd97d38dc509f0d6db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4564fb22046040fd97d38dc509f0d6db" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45339 } } }
I20260812 06:23:38.008160 30965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:38.008381 30976 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:38.008916 30976 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:38.010963 30976 catalog_manager.cc:1347] Generated new cluster ID: 259a5d1fbab34b378c95e21ea44ee99f
I20260812 06:23:38.011025 30976 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[30798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:38.015247 30955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:38.001005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56902 (local address 127.30.15.126:45339)
0812 06:23:38.001180 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:38.001189 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:38.001405 (+ 216us) server_negotiation.cc:407] Connection header received
0812 06:23:38.003469 (+ 2064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:38.003475 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:38.003518 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:38.003643 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:38.005042 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.005971 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.007442 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.008059 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.008160 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:38.012066 (+ 3906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:38.012070 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:38.012071 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:38.012081 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:38.013650 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:38.014017 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:38.014020 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:38.014020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:38.014103 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:38.014323 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:38.014324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:38.014324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:38.014535 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:38.014681 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:38.014944 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 06:23:38.015065 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":75,"threads_started":1}
I20260812 06:23:38.017148 30976 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:38.017819 30976 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:38.022145 30976 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4564fb22046040fd97d38dc509f0d6db: Generated new TSK 0
I20260812 06:23:38.022290 30976 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:23:38.049464 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45339
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:38.130731 31000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:38.130926 31000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:38.130959 31000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:38.132109 31000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:38.132148 31000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:38.132184 31000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:23:38.133586 31000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45339
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:38.133805 31000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:38.134003 31000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:38.138654 31012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:38.138672 31013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:38.138682 31016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:38.138823 31000 server_base.cc:1034] running on GCE node
I20260812 06:23:38.139096 31000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:38.139362 31000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:38.140529 31000 hybrid_clock.cc:648] HybridClock initialized: now 1786515818140511 us; error 29 us; skew 500 ppm
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[30798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515818, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:38.142899 31000 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:23:38.143316 31000 webserver.cc:460] Webserver started at http://127.30.15.65:45329/ using document root <none> and password file <none>
I20260812 06:23:38.143504 31000 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:38.143560 31000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:38.143721 31000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:38.144748 31000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "90d33bfb587749d09504468ba461c39b"
format_stamp: "Formatted at 2026-08-12 06:23:38 on dist-test-slave-gjrz"
server_key: "f11bb9452b3a65452ed52a4d6909d8e7"
server_key_iv: "cb6ecd20e08bad17f7b2f60d9b429cd6"
server_key_version: "encryptionkey@0"
I20260812 06:23:38.145079 31000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "90d33bfb587749d09504468ba461c39b"
format_stamp: "Formatted at 2026-08-12 06:23:38 on dist-test-slave-gjrz"
server_key: "f11bb9452b3a65452ed52a4d6909d8e7"
server_key_iv: "cb6ecd20e08bad17f7b2f60d9b429cd6"
server_key_version: "encryptionkey@0"
I20260812 06:23:38.146318 31000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:23:38.146970 31024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:38.147109 31000 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:38.147192 31000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "90d33bfb587749d09504468ba461c39b"
format_stamp: "Formatted at 2026-08-12 06:23:38 on dist-test-slave-gjrz"
server_key: "f11bb9452b3a65452ed52a4d6909d8e7"
server_key_iv: "cb6ecd20e08bad17f7b2f60d9b429cd6"
server_key_version: "encryptionkey@0"
I20260812 06:23:38.147257 31000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:38.161223 31000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:38.162832 31000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:38.162937 31000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:38.163108 31000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:38.163385 31000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:38.163420 31000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:38.163440 31000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:38.163457 31000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:38.169334 31000 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:43239
I20260812 06:23:38.169375 31231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:43239 every 8 connection(s)
I20260812 06:23:38.169670 31000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:23:38.174260 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 31000
I20260812 06:23:38.174340 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:23:38.174486 30781 external_mini_cluster.cc:1428] Setting key db31936f01104f6f04ff00674323f2cd
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[30798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515818, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:38.178659 30955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:38.170382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:39739 (local address 127.30.15.126:45339)
0812 06:23:38.170428 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:38.170430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:38.170644 (+ 214us) server_negotiation.cc:407] Connection header received
0812 06:23:38.171099 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:38.171101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:38.171111 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:38.171157 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:38.172076 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.172576 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.173578 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.173793 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.173840 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:38.176098 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:38.176100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:38.176100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:38.176107 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:38.177386 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:38.177830 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:38.177831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:38.177831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:38.177877 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:38.178108 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:38.178109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:38.178109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:38.178201 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:38.178247 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:38.178527 (+ 280us) server_negotiation.cc:299] Negotiation successful
0812 06:23:38.178594 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:23:38.178880 31236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:38.170365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:45339 (local address 127.30.15.65:39739)
0812 06:23:38.170531 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:38.170567 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:38.171019 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:38.171214 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:38.171217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:38.171812 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:38.172006 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:38.172011 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.172635 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.172635 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:38.173503 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:38.173505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.173859 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.173859 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:38.173967 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:38.174485 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:38.174493 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:38.176008 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:38.177463 (+ 1455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:38.177470 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:38.177472 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:38.177759 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:38.177927 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:38.177928 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:38.177928 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:38.178052 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:38.178253 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:38.178259 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:38.178408 (+ 149us) client_negotiation.cc:769] Sending connection context
0812 06:23:38.178514 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 06:23:38.178675 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":89,"threads_started":1}
I20260812 06:23:38.179467 31234 heartbeater.cc:347] Connected to a master server at 127.30.15.126:45339
I20260812 06:23:38.179577 31234 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:38.179785 31234 heartbeater.cc:511] Master 127.30.15.126:45339 requested a full tablet report, sending...
I20260812 06:23:38.180286 30872 ts_manager.cc:194] Registered new tserver with Master: 90d33bfb587749d09504468ba461c39b (127.30.15.65:43239)
I20260812 06:23:38.180869 30872 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:39739
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:23:38.200014 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45339
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:38.280447 31240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:38.280625 31240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:38.280647 31240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:38.281747 31240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:38.281786 31240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:38.281813 31240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:23:38.283246 31240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45339
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:38.283493 31240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:38.283699 31240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:38.288393 31255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:38.288403 31253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:38.288403 31259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:38.288604 31240 server_base.cc:1034] running on GCE node
I20260812 06:23:38.288781 31240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:38.288960 31240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:38.290092 31240 hybrid_clock.cc:648] HybridClock initialized: now 1786515818290078 us; error 29 us; skew 500 ppm
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[30798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515818, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:38.292461 31240 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:23:38.292824 31240 webserver.cc:460] Webserver started at http://127.30.15.66:42205/ using document root <none> and password file <none>
I20260812 06:23:38.293005 31240 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:38.293044 31240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:38.293133 31240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:38.294061 31240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "6993779f089c42498b202b888f69b16e"
format_stamp: "Formatted at 2026-08-12 06:23:38 on dist-test-slave-gjrz"
server_key: "c3320891b73328765ea3437c0c1f7d07"
server_key_iv: "f864f9263f80d180a58f18309ffa9b6a"
server_key_version: "encryptionkey@0"
I20260812 06:23:38.294329 31240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "6993779f089c42498b202b888f69b16e"
format_stamp: "Formatted at 2026-08-12 06:23:38 on dist-test-slave-gjrz"
server_key: "c3320891b73328765ea3437c0c1f7d07"
server_key_iv: "f864f9263f80d180a58f18309ffa9b6a"
server_key_version: "encryptionkey@0"
I20260812 06:23:38.295589 31240 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:23:38.296236 31274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:38.296399 31240 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:38.296485 31240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "6993779f089c42498b202b888f69b16e"
format_stamp: "Formatted at 2026-08-12 06:23:38 on dist-test-slave-gjrz"
server_key: "c3320891b73328765ea3437c0c1f7d07"
server_key_iv: "f864f9263f80d180a58f18309ffa9b6a"
server_key_version: "encryptionkey@0"
I20260812 06:23:38.296550 31240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:38.319737 31240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:38.321401 31240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:38.321520 31240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:38.321703 31240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:38.321990 31240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:38.322023 31240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:38.322050 31240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:38.322067 31240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:38.328054 31240 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:37801
I20260812 06:23:38.328125 31470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:37801 every 8 connection(s)
I20260812 06:23:38.328393 31240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[30798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515818, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:38.334463 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 31240
I20260812 06:23:38.334545 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:23:38.334684 30781 external_mini_cluster.cc:1428] Setting key e91822bb9d19025c748969562635572d
I20260812 06:23:38.337016 30955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:38.329071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:49461 (local address 127.30.15.126:45339)
0812 06:23:38.329116 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:38.329118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:38.329297 (+ 179us) server_negotiation.cc:407] Connection header received
0812 06:23:38.329791 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:38.329793 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:38.329805 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:38.329856 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:38.330734 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.331237 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.332216 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.332418 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.332473 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:38.334338 (+ 1865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:38.334340 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:38.334340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:38.334348 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:38.335805 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:38.336197 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:38.336198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:38.336199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:38.336261 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:38.336454 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:38.336454 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:38.336455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:38.336584 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:38.336645 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:38.336850 (+ 205us) server_negotiation.cc:299] Negotiation successful
0812 06:23:38.336929 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:23:38.337127 31476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:38.329040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:45339 (local address 127.30.15.66:49461)
0812 06:23:38.329181 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:38.329217 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:38.329694 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:38.329922 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:38.329926 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:38.330449 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:38.330640 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:38.330644 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.331340 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.331342 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:38.332133 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:38.332136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.332487 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.332489 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:38.332612 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:38.333002 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:38.333010 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:38.334235 (+ 1225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:38.335889 (+ 1654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:38.335917 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:38.335919 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:38.336131 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:38.336315 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:38.336315 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:38.336316 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:38.336403 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:38.336637 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:38.336640 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:38.336743 (+ 103us) client_negotiation.cc:769] Sending connection context
0812 06:23:38.336816 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 06:23:38.336961 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":71,"threads_started":1}
I20260812 06:23:38.337632 31473 heartbeater.cc:347] Connected to a master server at 127.30.15.126:45339
I20260812 06:23:38.337710 31473 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:38.337865 31473 heartbeater.cc:511] Master 127.30.15.126:45339 requested a full tablet report, sending...
I20260812 06:23:38.338219 30872 ts_manager.cc:194] Registered new tserver with Master: 6993779f089c42498b202b888f69b16e (127.30.15.66:37801)
I20260812 06:23:38.338582 30872 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:49461
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:23:38.358026 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45339
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:38.436726 31481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:38.436909 31481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:38.436940 31481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:38.438025 31481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:38.438072 31481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:38.438107 31481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:23:38.439513 31481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45339
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:38.439735 31481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:38.439931 31481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:38.444701 31500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:38.444766 31497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:38.444727 31502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:38.444828 31481 server_base.cc:1034] running on GCE node
I20260812 06:23:38.445020 31481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:38.445223 31481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:38.446365 31481 hybrid_clock.cc:648] HybridClock initialized: now 1786515818446354 us; error 25 us; skew 500 ppm
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[30798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515818, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:38.448669 31481 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:23:38.449066 31481 webserver.cc:460] Webserver started at http://127.30.15.67:45039/ using document root <none> and password file <none>
I20260812 06:23:38.449255 31481 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:38.449301 31481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:38.449419 31481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:38.450407 31481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "018024f96c174a82b77e80979a378e21"
format_stamp: "Formatted at 2026-08-12 06:23:38 on dist-test-slave-gjrz"
server_key: "b94330f4a1b2c69420332cc82e5bf8c7"
server_key_iv: "d063d32c82dd2bf95d9be5babab583e0"
server_key_version: "encryptionkey@0"
I20260812 06:23:38.450719 31481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "018024f96c174a82b77e80979a378e21"
format_stamp: "Formatted at 2026-08-12 06:23:38 on dist-test-slave-gjrz"
server_key: "b94330f4a1b2c69420332cc82e5bf8c7"
server_key_iv: "d063d32c82dd2bf95d9be5babab583e0"
server_key_version: "encryptionkey@0"
I20260812 06:23:38.452033 31481 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:23:38.452703 31514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:38.452848 31481 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:38.452934 31481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "018024f96c174a82b77e80979a378e21"
format_stamp: "Formatted at 2026-08-12 06:23:38 on dist-test-slave-gjrz"
server_key: "b94330f4a1b2c69420332cc82e5bf8c7"
server_key_iv: "d063d32c82dd2bf95d9be5babab583e0"
server_key_version: "encryptionkey@0"
I20260812 06:23:38.452991 31481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:38.471082 31481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:38.473148 31481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:38.473277 31481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:38.475437 31481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:38.475768 31481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:38.475808 31481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:38.475829 31481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:38.475839 31481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:38.481773 31481 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:35199
I20260812 06:23:38.481832 31726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:35199 every 8 connection(s)
I20260812 06:23:38.482125 31481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[30798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515818, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:38.490145 30955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:38.482772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:34697 (local address 127.30.15.126:45339)
0812 06:23:38.482830 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:38.482832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:38.483032 (+ 200us) server_negotiation.cc:407] Connection header received
0812 06:23:38.483556 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:38.483557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:38.483566 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:38.483617 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:38.484462 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.484972 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.485942 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.486119 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.486160 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:38.488116 (+ 1956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:38.488118 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:38.488118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:38.488125 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:38.489158 (+ 1033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:38.489489 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:38.489489 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:38.489489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:38.489532 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:38.489705 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:38.489705 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:38.489706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:38.489794 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:38.489836 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:38.490030 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 06:23:38.490085 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:23:38.490309 31734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:38.482733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:45339 (local address 127.30.15.67:34697)
0812 06:23:38.482878 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:38.482962 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:38.483472 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:38.483670 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:38.483673 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:38.484205 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:38.484398 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:38.484403 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.485051 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.485052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:38.485869 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:38.485872 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.486175 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.486175 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:38.486268 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:38.486678 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:38.486686 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:38.488033 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:38.489229 (+ 1196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:38.489235 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:38.489236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:38.489435 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:38.489582 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:38.489583 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:38.489583 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:38.489665 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:38.489834 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:38.489836 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:38.489943 (+ 107us) client_negotiation.cc:769] Sending connection context
0812 06:23:38.490015 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:23:38.490121 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":78,"threads_started":1}
I20260812 06:23:38.490736 31727 heartbeater.cc:347] Connected to a master server at 127.30.15.126:45339
I20260812 06:23:38.490832 31727 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:38.490993 31727 heartbeater.cc:511] Master 127.30.15.126:45339 requested a full tablet report, sending...
I20260812 06:23:38.491376 30872 ts_manager.cc:194] Registered new tserver with Master: 018024f96c174a82b77e80979a378e21 (127.30.15.67:35199)
I20260812 06:23:38.491724 30872 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:34697
I20260812 06:23:38.492180 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 31481
I20260812 06:23:38.492277 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:23:38.492450 30781 external_mini_cluster.cc:1428] Setting key 93691ade8b98ecbe0a1906e20471d2ed
I20260812 06:23:38.493428 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[30798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515818, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[30798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515818, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.15.65@KRBTEST.COM
I20260812 06:23:38.516131 31748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:38.509359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52754 (local address 127.30.15.65:43239)
0812 06:23:38.509522 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:38.509526 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:38.509535 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:23:38.509558 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:38.509560 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:38.509573 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:38.509632 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:38.510117 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.510791 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.511489 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.511777 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.511828 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:38.513654 (+ 1826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:38.513662 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:38.513662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:38.513668 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:38.515110 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:38.515461 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:38.515463 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:38.515464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:38.515518 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:38.515666 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:38.515666 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:38.515667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:38.515785 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:38.515911 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:38.515945 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 06:23:38.516013 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":93,"threads_started":1}
W20260812 06:23:38.516476 31078 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52754
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[30798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[30798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.65@KRBTEST.COM
I20260812 06:23:38.536824 31748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:38.531029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52768 (local address 127.30.15.65:43239)
0812 06:23:38.531072 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:38.531075 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:38.531084 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:23:38.531104 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:38.531105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:38.531113 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:38.531165 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:38.531688 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.532170 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.532809 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:38.533007 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:38.533050 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:38.534823 (+ 1773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:38.534825 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:38.534825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:38.534831 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:38.536092 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:38.536349 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:38.536349 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:38.536350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:38.536392 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:38.536507 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:38.536508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:38.536508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:38.536582 (+ 74us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:38.536658 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:38.536710 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 06:23:38.536765 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:23:38.537271 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 31000
I20260812 06:23:38.547581 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 31240
I20260812 06:23:38.563803 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 31481
I20260812 06:23:38.571858 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 30820
2026-08-12T06:23:38Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2047 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[31764](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[31764](info): set up 2 sockets
Aug 12 06:23:38 dist-test-slave-gjrz krb5kdc[31764](info): commencing operation
krb5kdc: starting...
W20260812 06:23:39.770694 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:23:39 dist-test-slave-gjrz krb5kdc[31764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:23:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:23:39.877780 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:38597
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:38597
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:39.957342 31790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:39.957525 31790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:39.957545 31790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:39.958627 31790 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:39.958665 31790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:39.958678 31790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:39.958690 31790 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:39.958705 31790 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:23:39.960109 31790 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:38597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:38597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:39.960284 31790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:39.960444 31790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:39.964860 31800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:39.964970 31790 server_base.cc:1034] running on GCE node
W20260812 06:23:39.964838 31809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:39.964845 31806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:39.965276 31790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:39.965523 31790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:39.966666 31790 hybrid_clock.cc:648] HybridClock initialized: now 1786515819966656 us; error 27 us; skew 500 ppm
Aug 12 06:23:39 dist-test-slave-gjrz krb5kdc[31764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515819, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:39.968950 31790 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:23:39.969336 31790 webserver.cc:460] Webserver started at http://127.30.15.126:35585/ using document root <none> and password file <none>
I20260812 06:23:39.969554 31790 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:39.969610 31790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:39.969697 31790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:39.970700 31790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "ca412998ec134c7a883f039d2718ddf4"
format_stamp: "Formatted at 2026-08-12 06:23:39 on dist-test-slave-gjrz"
server_key: "f32077fc508ada69a7023f1003fff232"
server_key_iv: "142d1cc8dd30e2836abdbd60487c1bf6"
server_key_version: "encryptionkey@0"
I20260812 06:23:39.970981 31790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "ca412998ec134c7a883f039d2718ddf4"
format_stamp: "Formatted at 2026-08-12 06:23:39 on dist-test-slave-gjrz"
server_key: "f32077fc508ada69a7023f1003fff232"
server_key_iv: "142d1cc8dd30e2836abdbd60487c1bf6"
server_key_version: "encryptionkey@0"
I20260812 06:23:39.972189 31790 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:23:39.972775 31818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:39.972913 31790 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:39.972988 31790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "ca412998ec134c7a883f039d2718ddf4"
format_stamp: "Formatted at 2026-08-12 06:23:39 on dist-test-slave-gjrz"
server_key: "f32077fc508ada69a7023f1003fff232"
server_key_iv: "142d1cc8dd30e2836abdbd60487c1bf6"
server_key_version: "encryptionkey@0"
I20260812 06:23:39.973052 31790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:39.988669 31790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:39.990305 31790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:39.990422 31790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:39.994110 31790 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:38597
I20260812 06:23:39.994144 31918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:38597 every 8 connection(s)
I20260812 06:23:39.994427 31790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:39.995196 31919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:39.997278 31919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4: Bootstrap starting.
I20260812 06:23:39.997779 31919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:39.997998 31919 log.cc:824] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:39.998597 31919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4: No bootstrap required, opened a new log
I20260812 06:23:40.000219 31919 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca412998ec134c7a883f039d2718ddf4" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38597 } }
I20260812 06:23:40.000348 31919 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:40.000370 31919 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca412998ec134c7a883f039d2718ddf4, State: Initialized, Role: FOLLOWER
I20260812 06:23:40.000469 31919 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca412998ec134c7a883f039d2718ddf4" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38597 } }
I20260812 06:23:40.000540 31919 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:40.000571 31919 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:40.000602 31919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:40.001037 31919 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca412998ec134c7a883f039d2718ddf4" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38597 } }
I20260812 06:23:40.001123 31919 leader_election.cc:302] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca412998ec134c7a883f039d2718ddf4; no voters:
I20260812 06:23:40.001235 31919 leader_election.cc:288] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:40.001286 31923 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:40.001430 31923 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [term 1 LEADER]: Becoming Leader. State: Replica: ca412998ec134c7a883f039d2718ddf4, State: Running, Role: LEADER
I20260812 06:23:40.001464 31919 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:40.001519 31923 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca412998ec134c7a883f039d2718ddf4" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38597 } }
I20260812 06:23:40.001911 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 31790
I20260812 06:23:40.001999 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:40.002153 30781 external_mini_cluster.cc:1428] Setting key d90a5dd67aa0f0438d28153a29d5d818
I20260812 06:23:40.002638 31927 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca412998ec134c7a883f039d2718ddf4. Latest consensus state: current_term: 1 leader_uuid: "ca412998ec134c7a883f039d2718ddf4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca412998ec134c7a883f039d2718ddf4" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38597 } } }
I20260812 06:23:40.002734 31927 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:40.003057 31954 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:40.003085 31924 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca412998ec134c7a883f039d2718ddf4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca412998ec134c7a883f039d2718ddf4" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38597 } } }
I20260812 06:23:40.003145 31924 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:40.003551 31954 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:40.005033 31954 catalog_manager.cc:1347] Generated new cluster ID: 720af34d84be45cd8f735256afdf7a2d
I20260812 06:23:40.005084 31954 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:40.013206 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.002752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56232 (local address 127.30.15.126:38597)
0812 06:23:40.002925 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.002934 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.002964 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:23:40.003091 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.003097 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.003151 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.003302 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:40.003918 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.005308 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.006369 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.006954 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.007045 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.009746 (+ 2701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:40.009751 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:40.009751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:40.009764 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:40.011685 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.012050 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.012052 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.012053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.012170 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.012345 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.012346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.012346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.012642 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:40.012796 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.012861 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.012991 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":82,"threads_started":1}
I20260812 06:23:40.018040 31954 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:40.018697 31954 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:40.023280 31954 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca412998ec134c7a883f039d2718ddf4: Generated new TSK 0
I20260812 06:23:40.023437 31954 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:23:40.049750 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38597
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:40.129937 31963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:40.130116 31963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:40.130138 31963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:40.131222 31963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:40.131256 31963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:40.131299 31963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:23:40.132731 31963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38597
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:40.132910 31963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:40.133085 31963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:40.138098 31974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:40.138108 31977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:40.138129 31973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:40.138167 31963 server_base.cc:1034] running on GCE node
I20260812 06:23:40.138530 31963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:40.138748 31963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:40.139937 31963 hybrid_clock.cc:648] HybridClock initialized: now 1786515820139921 us; error 29 us; skew 500 ppm
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[31764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515820, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:40.142459 31963 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:23:40.142887 31963 webserver.cc:460] Webserver started at http://127.30.15.65:32797/ using document root <none> and password file <none>
I20260812 06:23:40.143100 31963 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:40.143146 31963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:40.143311 31963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:40.144333 31963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "0018c34531ec47dcb1f4fb7c2e2d5441"
format_stamp: "Formatted at 2026-08-12 06:23:40 on dist-test-slave-gjrz"
server_key: "99573cbd49aeb4b42d10f828bd801af2"
server_key_iv: "9c5f65fb49699e7e5053989c3aac3c4b"
server_key_version: "encryptionkey@0"
I20260812 06:23:40.144663 31963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "0018c34531ec47dcb1f4fb7c2e2d5441"
format_stamp: "Formatted at 2026-08-12 06:23:40 on dist-test-slave-gjrz"
server_key: "99573cbd49aeb4b42d10f828bd801af2"
server_key_iv: "9c5f65fb49699e7e5053989c3aac3c4b"
server_key_version: "encryptionkey@0"
I20260812 06:23:40.145973 31963 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:23:40.146639 31998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:40.146804 31963 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:40.146916 31963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "0018c34531ec47dcb1f4fb7c2e2d5441"
format_stamp: "Formatted at 2026-08-12 06:23:40 on dist-test-slave-gjrz"
server_key: "99573cbd49aeb4b42d10f828bd801af2"
server_key_iv: "9c5f65fb49699e7e5053989c3aac3c4b"
server_key_version: "encryptionkey@0"
I20260812 06:23:40.146976 31963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:40.166826 31963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:40.168833 31963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:40.168972 31963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:40.169167 31963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:40.169442 31963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:40.169476 31963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:40.169502 31963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:40.169519 31963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:40.175370 31963 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:46545
I20260812 06:23:40.175454 32208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:46545 every 8 connection(s)
I20260812 06:23:40.175710 31963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515820, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:40.184326 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.176349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:58045 (local address 127.30.15.126:38597)
0812 06:23:40.176389 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.176391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.176615 (+ 224us) server_negotiation.cc:407] Connection header received
0812 06:23:40.177485 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.177486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.177497 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.177549 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:40.178111 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.178608 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.179690 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.179897 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.179954 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.181798 (+ 1844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:40.181800 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:40.181800 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:40.181806 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:40.183083 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.183517 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.183517 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.183518 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.183563 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.183749 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.183749 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.183749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.183838 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:40.183905 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.184149 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.184241 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:23:40.184312 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 31963
I20260812 06:23:40.184361 32211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.176333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:38597 (local address 127.30.15.65:58045)
0812 06:23:40.176479 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:40.176511 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:40.177396 (+ 885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:40.177601 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:40.177604 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:40.177835 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:40.178011 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.178015 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.178686 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.178687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.179592 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.179596 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.179960 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.179961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.180072 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.180442 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:40.180449 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:40.181717 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:40.183173 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:40.183181 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:40.183183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:40.183456 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:40.183613 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:40.183614 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:40.183614 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:40.183709 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:40.183884 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:40.183888 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:40.184006 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 06:23:40.184090 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 06:23:40.184206 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":85,"threads_started":1}
I20260812 06:23:40.184403 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:23:40.184554 30781 external_mini_cluster.cc:1428] Setting key b37d169763849e9e073ad20297aa30d8
I20260812 06:23:40.185045 32209 heartbeater.cc:347] Connected to a master server at 127.30.15.126:38597
I20260812 06:23:40.185124 32209 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:40.185297 32209 heartbeater.cc:511] Master 127.30.15.126:38597 requested a full tablet report, sending...
I20260812 06:23:40.185809 31845 ts_manager.cc:194] Registered new tserver with Master: 0018c34531ec47dcb1f4fb7c2e2d5441 (127.30.15.65:46545)
I20260812 06:23:40.186395 31845 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:58045
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:23:40.207773 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38597
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:40.286026 32217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:40.286211 32217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:40.286233 32217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:40.287364 32217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:40.287401 32217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:40.287429 32217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:23:40.288841 32217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38597
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:40.289057 32217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:40.289249 32217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:40.293849 32232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:40.293838 32230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:40.293967 32217 server_base.cc:1034] running on GCE node
W20260812 06:23:40.293840 32234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:40.294248 32217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:40.294453 32217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:40.295583 32217 hybrid_clock.cc:648] HybridClock initialized: now 1786515820295566 us; error 32 us; skew 500 ppm
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[31764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515820, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:40.297848 32217 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:23:40.298218 32217 webserver.cc:460] Webserver started at http://127.30.15.66:32821/ using document root <none> and password file <none>
I20260812 06:23:40.298393 32217 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:40.298432 32217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:40.298552 32217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:40.299528 32217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "4dd1dc22acaf466499756feaa5aad727"
format_stamp: "Formatted at 2026-08-12 06:23:40 on dist-test-slave-gjrz"
server_key: "752e7b7a2fa711f7988c7ff6e2b83b46"
server_key_iv: "d44af1e184cd2dd8b1c8acc8b15062de"
server_key_version: "encryptionkey@0"
I20260812 06:23:40.299827 32217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "4dd1dc22acaf466499756feaa5aad727"
format_stamp: "Formatted at 2026-08-12 06:23:40 on dist-test-slave-gjrz"
server_key: "752e7b7a2fa711f7988c7ff6e2b83b46"
server_key_iv: "d44af1e184cd2dd8b1c8acc8b15062de"
server_key_version: "encryptionkey@0"
I20260812 06:23:40.300989 32217 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:40.301658 32245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:40.301801 32217 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:40.301887 32217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "4dd1dc22acaf466499756feaa5aad727"
format_stamp: "Formatted at 2026-08-12 06:23:40 on dist-test-slave-gjrz"
server_key: "752e7b7a2fa711f7988c7ff6e2b83b46"
server_key_iv: "d44af1e184cd2dd8b1c8acc8b15062de"
server_key_version: "encryptionkey@0"
I20260812 06:23:40.301950 32217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:40.325363 32217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:40.327329 32217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:40.327445 32217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:40.327659 32217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:40.327943 32217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:40.327975 32217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:40.328002 32217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:40.328019 32217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:40.333432 32217 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:42727
I20260812 06:23:40.333490 32446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:42727 every 8 connection(s)
I20260812 06:23:40.333775 32217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515820, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:40.341789 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 32217
I20260812 06:23:40.341892 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:23:40.342067 30781 external_mini_cluster.cc:1428] Setting key 5f045150058d3bddb2a655dcc892116c
I20260812 06:23:40.342267 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.334593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:60405 (local address 127.30.15.126:38597)
0812 06:23:40.334655 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.334657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.334667 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:23:40.335612 (+ 945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.335614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.335627 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.335676 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:40.336249 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.336753 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.337729 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.337927 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.337981 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.339912 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:40.339913 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:40.339913 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:40.339920 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:40.341118 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.341416 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.341417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.341417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.341459 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.341652 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.341652 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.341653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.341781 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:40.341850 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.342114 (+ 264us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.342198 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:23:40.342456 32457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.334402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:38597 (local address 127.30.15.66:60405)
0812 06:23:40.334565 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:40.334597 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:40.335509 (+ 912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:40.335739 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:40.335742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:40.335978 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:40.336164 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.336169 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.336834 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.336835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.337649 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.337652 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.337994 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.337994 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.338108 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.338537 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:40.338545 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:40.339832 (+ 1287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:40.341176 (+ 1344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:40.341178 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:40.341180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:40.341366 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:40.341502 (+ 136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:40.341502 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:40.341502 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:40.341590 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:40.341836 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:40.341840 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:40.341992 (+ 152us) client_negotiation.cc:769] Sending connection context
0812 06:23:40.342073 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 06:23:40.342224 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
I20260812 06:23:40.342918 32450 heartbeater.cc:347] Connected to a master server at 127.30.15.126:38597
I20260812 06:23:40.343024 32450 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:40.343197 32450 heartbeater.cc:511] Master 127.30.15.126:38597 requested a full tablet report, sending...
I20260812 06:23:40.343582 31845 ts_manager.cc:194] Registered new tserver with Master: 4dd1dc22acaf466499756feaa5aad727 (127.30.15.66:42727)
I20260812 06:23:40.343935 31845 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:60405
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:23:40.365430 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38597
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:40.445379 32460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:40.445559 32460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:40.445581 32460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:40.446651 32460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:40.446683 32460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:40.446708 32460 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:23:40.448141 32460 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38597
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32460
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:40.448307 32460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:40.448470 32460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:23:40.453346 32460 server_base.cc:1034] running on GCE node
W20260812 06:23:40.453418 32471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:40.453466 32468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:40.453367 32466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:40.453799 32460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:40.454037 32460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:40.455185 32460 hybrid_clock.cc:648] HybridClock initialized: now 1786515820455167 us; error 31 us; skew 500 ppm
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[31764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515820, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:40.457513 32460 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:23:40.457918 32460 webserver.cc:460] Webserver started at http://127.30.15.67:36825/ using document root <none> and password file <none>
I20260812 06:23:40.458114 32460 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:40.458160 32460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:40.458279 32460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:40.459314 32460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "31ee60f54a1a453990b3f03419c43913"
format_stamp: "Formatted at 2026-08-12 06:23:40 on dist-test-slave-gjrz"
server_key: "dce75c1d2a3de06e028d69b8cae7c97d"
server_key_iv: "d5ed609a1f44922497261d0445541960"
server_key_version: "encryptionkey@0"
I20260812 06:23:40.459642 32460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "31ee60f54a1a453990b3f03419c43913"
format_stamp: "Formatted at 2026-08-12 06:23:40 on dist-test-slave-gjrz"
server_key: "dce75c1d2a3de06e028d69b8cae7c97d"
server_key_iv: "d5ed609a1f44922497261d0445541960"
server_key_version: "encryptionkey@0"
I20260812 06:23:40.460813 32460 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:23:40.461438 32495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:40.461609 32460 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:40.461692 32460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "31ee60f54a1a453990b3f03419c43913"
format_stamp: "Formatted at 2026-08-12 06:23:40 on dist-test-slave-gjrz"
server_key: "dce75c1d2a3de06e028d69b8cae7c97d"
server_key_iv: "d5ed609a1f44922497261d0445541960"
server_key_version: "encryptionkey@0"
I20260812 06:23:40.461752 32460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:40.492905 32460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:40.495303 32460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:40.495452 32460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:40.495716 32460 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:40.496080 32460 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:40.496132 32460 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:40.496163 32460 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:40.496189 32460 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:40.505532 32460 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:42619
I20260812 06:23:40.505648 32708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:42619 every 8 connection(s)
I20260812 06:23:40.505934 32460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:23:40.512995 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 32460
I20260812 06:23:40.513099 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515820, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:40.513259 30781 external_mini_cluster.cc:1428] Setting key f6cd76370017ca4428a74392e0cde357
I20260812 06:23:40.516821 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.506639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:36073 (local address 127.30.15.126:38597)
0812 06:23:40.506682 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.506684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.506977 (+ 293us) server_negotiation.cc:407] Connection header received
0812 06:23:40.508223 (+ 1246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.508225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.508238 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.508289 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:40.509027 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.509782 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.511083 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.511330 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.511406 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.513690 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:40.513691 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:40.513691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:40.513699 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:40.515348 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.515815 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.515816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.515817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.515884 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.516130 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.516130 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.516131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.516275 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:40.516347 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.516643 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.516725 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:23:40.516980 32713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.506641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:38597 (local address 127.30.15.67:36073)
0812 06:23:40.506821 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:40.506869 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:40.508117 (+ 1248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:40.508359 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:40.508363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:40.508691 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:40.508941 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.508948 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.509869 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.509870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.510992 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.510995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.511411 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.511412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.511547 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.512023 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:40.512032 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:40.513610 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:40.515441 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:40.515449 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:40.515452 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:40.515742 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:40.515948 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:40.515949 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:40.515949 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:40.516066 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:40.516337 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:40.516343 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:40.516502 (+ 159us) client_negotiation.cc:769] Sending connection context
0812 06:23:40.516606 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 06:23:40.516761 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":87,"threads_started":1}
I20260812 06:23:40.517427 32709 heartbeater.cc:347] Connected to a master server at 127.30.15.126:38597
I20260812 06:23:40.517521 32709 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:40.517716 32709 heartbeater.cc:511] Master 127.30.15.126:38597 requested a full tablet report, sending...
I20260812 06:23:40.518110 31845 ts_manager.cc:194] Registered new tserver with Master: 31ee60f54a1a453990b3f03419c43913 (127.30.15.67:42619)
I20260812 06:23:40.518603 31845 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:36073
I20260812 06:23:40.524847 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:23:40.531126 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.526285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56238 (local address 127.30.15.126:38597)
0812 06:23:40.526324 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.526325 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.526437 (+ 112us) server_negotiation.cc:407] Connection header received
0812 06:23:40.526484 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.526485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.526494 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.526525 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:40.526998 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.527498 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.528182 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.528349 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.528387 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.529377 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:40.529377 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:40.529377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:40.529381 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:40.530343 (+ 962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.530609 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.530610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.530610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.530650 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.530767 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.530767 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.530768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.530882 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:40.530946 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.531017 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.531068 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:23:40.533037 31845 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56238:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:23:40.534526 31845 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:23:40.540516 32730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.536584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:42727 (local address 127.0.0.1:45394)
0812 06:23:40.536766 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:40.536803 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:40.536862 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:40.537110 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:40.537114 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:40.537116 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:40.537176 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.537178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.538448 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.538449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.539406 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.539409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.540227 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.540227 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.540314 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.540326 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 06:23:40.540397 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:23:40.540445 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":75,"thread_start_us":57,"threads_started":1}
I20260812 06:23:40.540541 32732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.536701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45394 (local address 127.30.15.66:42727)
0812 06:23:40.536953 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.536957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.536968 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:23:40.537006 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.537008 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.537023 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.537096 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:40.537260 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.538337 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.539490 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.540147 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.540219 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.540275 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.540417 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.540459 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":82,"threads_started":1}
I20260812 06:23:40.540853 32738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.536777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:46545 (local address 127.0.0.1:47204)
0812 06:23:40.536997 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:40.537006 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:40.537063 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:40.537305 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:40.537306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:40.537308 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:40.537349 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.537350 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.538404 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.538405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.539670 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.539673 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.540628 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.540630 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.540691 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.540695 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:23:40.540745 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:23:40.540787 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":52,"thread_start_us":79,"threads_started":1}
I20260812 06:23:40.541074 32729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.536638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:42619 (local address 127.0.0.1:39430)
0812 06:23:40.536867 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:40.536878 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:40.536930 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:40.537435 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:40.537436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:40.537439 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:40.537471 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.537472 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.538676 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.538677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.539917 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.539919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.540848 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.540849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.540913 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.540917 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:23:40.540971 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:23:40.541009 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":76,"threads_started":1}
I20260812 06:23:40.541121 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.536777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39430 (local address 127.30.15.67:42619)
0812 06:23:40.537239 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.537243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.537252 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:23:40.537281 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.537283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.537296 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.537362 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:40.537551 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.538582 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.539982 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.540700 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.540760 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.540816 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.541005 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.541049 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":76,"threads_started":1}
I20260812 06:23:40.541136 32741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.536994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47204 (local address 127.30.15.65:46545)
0812 06:23:40.537174 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.537177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.537185 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:23:40.537218 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.537219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.537233 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.537311 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:40.537626 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.538310 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.539756 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.540471 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.540533 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.540591 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.541006 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.541064 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":78,"threads_started":1}
I20260812 06:23:40.541344 32337 tablet_service.cc:1467] Processing CreateTablet for tablet 3db84d16ea724a2b8f39ad533dba801e (DEFAULT_TABLE table=test-table [id=957aaa3cd3da424eb4df2042c94f0356]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:40.541699 32337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3db84d16ea724a2b8f39ad533dba801e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:40.541755 32594 tablet_service.cc:1467] Processing CreateTablet for tablet 3db84d16ea724a2b8f39ad533dba801e (DEFAULT_TABLE table=test-table [id=957aaa3cd3da424eb4df2042c94f0356]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:40.542064 32594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3db84d16ea724a2b8f39ad533dba801e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:40.543638 32085 tablet_service.cc:1467] Processing CreateTablet for tablet 3db84d16ea724a2b8f39ad533dba801e (DEFAULT_TABLE table=test-table [id=957aaa3cd3da424eb4df2042c94f0356]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:40.543877 32085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3db84d16ea724a2b8f39ad533dba801e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:40.545032 32742 tablet_bootstrap.cc:492] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727: Bootstrap starting.
I20260812 06:23:40.545702 32742 tablet_bootstrap.cc:654] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:40.546270 32742 log.cc:824] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:40.546645 32744 tablet_bootstrap.cc:492] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913: Bootstrap starting.
I20260812 06:23:40.546831 32746 tablet_bootstrap.cc:492] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441: Bootstrap starting.
I20260812 06:23:40.547194 32742 tablet_bootstrap.cc:492] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727: No bootstrap required, opened a new log
I20260812 06:23:40.547286 32744 tablet_bootstrap.cc:654] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:40.547290 32742 ts_tablet_manager.cc:1397] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:23:40.547497 32746 tablet_bootstrap.cc:654] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:40.547873 32744 log.cc:824] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:40.548065 32746 log.cc:824] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:40.548712 32746 tablet_bootstrap.cc:492] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441: No bootstrap required, opened a new log
I20260812 06:23:40.548705 32744 tablet_bootstrap.cc:492] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913: No bootstrap required, opened a new log
I20260812 06:23:40.548771 32744 ts_tablet_manager.cc:1397] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:23:40.548770 32746 ts_tablet_manager.cc:1397] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:23:40.549299 32742 raft_consensus.cc:348] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dd1dc22acaf466499756feaa5aad727" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42727 } } peers { permanent_uuid: "0018c34531ec47dcb1f4fb7c2e2d5441" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46545 } } peers { permanent_uuid: "31ee60f54a1a453990b3f03419c43913" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 42619 } }
I20260812 06:23:40.549480 32742 raft_consensus.cc:374] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:40.549516 32742 raft_consensus.cc:729] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dd1dc22acaf466499756feaa5aad727, State: Initialized, Role: FOLLOWER
I20260812 06:23:40.549652 32742 consensus_queue.cc:260] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dd1dc22acaf466499756feaa5aad727" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42727 } } peers { permanent_uuid: "0018c34531ec47dcb1f4fb7c2e2d5441" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46545 } } peers { permanent_uuid: "31ee60f54a1a453990b3f03419c43913" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 42619 } }
I20260812 06:23:40.549955 32742 ts_tablet_manager.cc:1428] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:23:40.550088 32450 heartbeater.cc:503] Master 127.30.15.126:38597 was elected leader, sending a full tablet report...
I20260812 06:23:40.550451 32746 raft_consensus.cc:348] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dd1dc22acaf466499756feaa5aad727" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42727 } } peers { permanent_uuid: "0018c34531ec47dcb1f4fb7c2e2d5441" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46545 } } peers { permanent_uuid: "31ee60f54a1a453990b3f03419c43913" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 42619 } }
I20260812 06:23:40.550633 32746 raft_consensus.cc:374] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:40.550673 32746 raft_consensus.cc:729] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0018c34531ec47dcb1f4fb7c2e2d5441, State: Initialized, Role: FOLLOWER
I20260812 06:23:40.550608 32744 raft_consensus.cc:348] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dd1dc22acaf466499756feaa5aad727" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42727 } } peers { permanent_uuid: "0018c34531ec47dcb1f4fb7c2e2d5441" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46545 } } peers { permanent_uuid: "31ee60f54a1a453990b3f03419c43913" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 42619 } }
I20260812 06:23:40.550773 32744 raft_consensus.cc:374] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:40.550819 32744 raft_consensus.cc:729] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ee60f54a1a453990b3f03419c43913, State: Initialized, Role: FOLLOWER
I20260812 06:23:40.550788 32746 consensus_queue.cc:260] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dd1dc22acaf466499756feaa5aad727" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42727 } } peers { permanent_uuid: "0018c34531ec47dcb1f4fb7c2e2d5441" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46545 } } peers { permanent_uuid: "31ee60f54a1a453990b3f03419c43913" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 42619 } }
I20260812 06:23:40.550925 32744 consensus_queue.cc:260] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dd1dc22acaf466499756feaa5aad727" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42727 } } peers { permanent_uuid: "0018c34531ec47dcb1f4fb7c2e2d5441" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46545 } } peers { permanent_uuid: "31ee60f54a1a453990b3f03419c43913" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 42619 } }
I20260812 06:23:40.551056 32746 ts_tablet_manager.cc:1428] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:23:40.551090 32209 heartbeater.cc:503] Master 127.30.15.126:38597 was elected leader, sending a full tablet report...
I20260812 06:23:40.551219 32744 ts_tablet_manager.cc:1428] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:23:40.551288 32709 heartbeater.cc:503] Master 127.30.15.126:38597 was elected leader, sending a full tablet report...
I20260812 06:23:40.562404 32762 raft_consensus.cc:482] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:23:40.562477 32762 raft_consensus.cc:504] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dd1dc22acaf466499756feaa5aad727" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42727 } } peers { permanent_uuid: "0018c34531ec47dcb1f4fb7c2e2d5441" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46545 } } peers { permanent_uuid: "31ee60f54a1a453990b3f03419c43913" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 42619 } }
I20260812 06:23:40.562749 32762 leader_election.cc:288] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0018c34531ec47dcb1f4fb7c2e2d5441 (127.30.15.65:46545), 31ee60f54a1a453990b3f03419c43913 (127.30.15.67:42619)
I20260812 06:23:40.565470 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.562934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:34779 (local address 127.30.15.67:42619)
0812 06:23:40.562984 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.562986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.563129 (+ 143us) server_negotiation.cc:407] Connection header received
0812 06:23:40.563170 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.563171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.563181 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.563246 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:40.563417 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.563869 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.564793 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.565177 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.565231 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.565240 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.565380 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.565415 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:23:40.565485 32765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.562876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:42619 (local address 127.30.15.66:34779)
0812 06:23:40.563060 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:40.563069 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:40.563124 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:40.563251 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:40.563252 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:40.563253 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:40.563334 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.563336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.563940 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.563941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.564719 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.564721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.565253 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.565254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.565326 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.565329 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:23:40.565371 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 06:23:40.565409 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":55,"thread_start_us":80,"threads_started":1}
I20260812 06:23:40.565557 32741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.562959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:46103 (local address 127.30.15.65:46545)
0812 06:23:40.562994 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.562995 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.563004 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:23:40.563024 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.563025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.563033 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.563080 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:40.563200 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.563766 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.564771 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.565245 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.565303 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.565311 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.565460 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.565494 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:23:40.565804 32631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db84d16ea724a2b8f39ad533dba801e" candidate_uuid: "4dd1dc22acaf466499756feaa5aad727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ee60f54a1a453990b3f03419c43913" is_pre_election: true
I20260812 06:23:40.565840 32457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.562876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:46545 (local address 127.30.15.66:46103)
0812 06:23:40.562925 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:40.562936 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:40.562982 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:40.563087 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:40.563088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:40.563089 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:40.563147 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.563149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.563835 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.563836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.564693 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:40.564696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.565315 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.565316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:40.565404 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.565407 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:23:40.565449 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 06:23:40.565489 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":1}
I20260812 06:23:40.565905 32631 raft_consensus.cc:2454] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dd1dc22acaf466499756feaa5aad727 in term 0.
I20260812 06:23:40.566115 32124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db84d16ea724a2b8f39ad533dba801e" candidate_uuid: "4dd1dc22acaf466499756feaa5aad727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0018c34531ec47dcb1f4fb7c2e2d5441" is_pre_election: true
I20260812 06:23:40.566181 32253 leader_election.cc:302] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ee60f54a1a453990b3f03419c43913, 4dd1dc22acaf466499756feaa5aad727; no voters:
I20260812 06:23:40.566223 32124 raft_consensus.cc:2454] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dd1dc22acaf466499756feaa5aad727 in term 0.
I20260812 06:23:40.566291 32762 raft_consensus.cc:2781] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:23:40.566352 32762 raft_consensus.cc:482] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:23:40.566375 32762 raft_consensus.cc:3037] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:40.566967 32762 raft_consensus.cc:504] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dd1dc22acaf466499756feaa5aad727" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42727 } } peers { permanent_uuid: "0018c34531ec47dcb1f4fb7c2e2d5441" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46545 } } peers { permanent_uuid: "31ee60f54a1a453990b3f03419c43913" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 42619 } }
I20260812 06:23:40.567076 32762 leader_election.cc:288] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [CANDIDATE]: Term 1 election: Requested vote from peers 0018c34531ec47dcb1f4fb7c2e2d5441 (127.30.15.65:46545), 31ee60f54a1a453990b3f03419c43913 (127.30.15.67:42619)
I20260812 06:23:40.567209 32631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db84d16ea724a2b8f39ad533dba801e" candidate_uuid: "4dd1dc22acaf466499756feaa5aad727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ee60f54a1a453990b3f03419c43913"
I20260812 06:23:40.567236 32124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db84d16ea724a2b8f39ad533dba801e" candidate_uuid: "4dd1dc22acaf466499756feaa5aad727" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0018c34531ec47dcb1f4fb7c2e2d5441"
I20260812 06:23:40.567306 32631 raft_consensus.cc:3037] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:40.567322 32124 raft_consensus.cc:3037] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:40.567910 32124 raft_consensus.cc:2454] T 3db84d16ea724a2b8f39ad533dba801e P 0018c34531ec47dcb1f4fb7c2e2d5441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd1dc22acaf466499756feaa5aad727 in term 1.
I20260812 06:23:40.567919 32631 raft_consensus.cc:2454] T 3db84d16ea724a2b8f39ad533dba801e P 31ee60f54a1a453990b3f03419c43913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dd1dc22acaf466499756feaa5aad727 in term 1.
I20260812 06:23:40.568087 32250 leader_election.cc:302] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0018c34531ec47dcb1f4fb7c2e2d5441, 4dd1dc22acaf466499756feaa5aad727; no voters:
I20260812 06:23:40.568171 32762 raft_consensus.cc:2781] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:40.568296 32762 raft_consensus.cc:686] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [term 1 LEADER]: Becoming Leader. State: Replica: 4dd1dc22acaf466499756feaa5aad727, State: Running, Role: LEADER
I20260812 06:23:40.568365 32762 consensus_queue.cc:237] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dd1dc22acaf466499756feaa5aad727" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42727 } } peers { permanent_uuid: "0018c34531ec47dcb1f4fb7c2e2d5441" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46545 } } peers { permanent_uuid: "31ee60f54a1a453990b3f03419c43913" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 42619 } }
I20260812 06:23:40.569016 31845 catalog_manager.cc:5495] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dd1dc22acaf466499756feaa5aad727 (127.30.15.66). New cstate: current_term: 1 leader_uuid: "4dd1dc22acaf466499756feaa5aad727" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dd1dc22acaf466499756feaa5aad727" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0018c34531ec47dcb1f4fb7c2e2d5441" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ee60f54a1a453990b3f03419c43913" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 42619 } health_report { overall_health: UNKNOWN } } }
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.65@KRBTEST.COM
I20260812 06:23:40.577909 32741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.571843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47218 (local address 127.30.15.65:46545)
0812 06:23:40.571878 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.571880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.571998 (+ 118us) server_negotiation.cc:407] Connection header received
0812 06:23:40.572037 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.572038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.572046 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.572087 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:40.572561 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.572969 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.573580 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.573745 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.573784 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.575800 (+ 2016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:40.575806 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:40.575806 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:40.575813 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:40.577127 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.577394 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.577396 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.577396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.577439 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.577566 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.577567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.577567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.577667 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:40.577754 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.577802 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.577857 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 06:23:40.584299 32453 tablet.cc:2369] T 3db84d16ea724a2b8f39ad533dba801e P 4dd1dc22acaf466499756feaa5aad727: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[31764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515820, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515820, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.15.65@KRBTEST.COM
I20260812 06:23:40.599524 32741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.593337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47232 (local address 127.30.15.65:46545)
0812 06:23:40.593389 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.593391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.593453 (+ 62us) server_negotiation.cc:407] Connection header received
0812 06:23:40.593504 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.593505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.593514 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.593555 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:40.594050 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.594493 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.595178 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.595410 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.595463 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.597355 (+ 1892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:40.597357 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:40.597357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:40.597364 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:40.598529 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.598817 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.598818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.598818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.598870 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.599033 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.599034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.599035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.599126 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:40.599204 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.599378 (+ 174us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.599446 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[31764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[31764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.65@KRBTEST.COM
I20260812 06:23:40.619133 32741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:40.613645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47238 (local address 127.30.15.65:46545)
0812 06:23:40.613707 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:40.613708 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:40.613760 (+ 52us) server_negotiation.cc:407] Connection header received
0812 06:23:40.613798 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:40.613799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:40.613806 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:40.613849 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:40.614289 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.614714 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.615400 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:40.615574 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:40.615614 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:40.617416 (+ 1802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:40.617417 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:40.617418 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:40.617423 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:40.618413 (+ 990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.618671 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.618672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.618672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.618715 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:40.618830 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:40.618830 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:40.618830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:40.618902 (+ 72us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:40.618961 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:40.619028 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 06:23:40.619078 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260812 06:23:40.619565 32043 tablet_service.cc:2908] Rejecting scan request for tablet 3db84d16ea724a2b8f39ad533dba801e: Uninitialized: clean time has not yet been initialized
I20260812 06:23:40.620298 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 31963
I20260812 06:23:40.645218 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 32217
I20260812 06:23:40.660336 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 32460
I20260812 06:23:40.669193 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 31790
2026-08-12T06:23:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2086 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[331](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[331](info): set up 2 sockets
Aug 12 06:23:40 dist-test-slave-gjrz krb5kdc[331](info): commencing operation
krb5kdc: starting...
W20260812 06:23:41.859761 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:23:41 dist-test-slave-gjrz krb5kdc[331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:23:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:23:41.969549 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:41193
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:46261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:41193
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:42.048102 350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:42.048305 350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:42.048337 350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:42.049443 350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:42.049480 350 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:23:42.049499 350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:42.049515 350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:42.049530 350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:42.049546 350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:23:42.050974 350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:46261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:41193
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:41193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:42.051211 350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:42.051429 350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:42.056000 364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:42.056042 361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:42.055987 360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:42.056185 350 server_base.cc:1034] running on GCE node
I20260812 06:23:42.056432 350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:42.056667 350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:42.057801 350 hybrid_clock.cc:648] HybridClock initialized: now 1786515822057788 us; error 29 us; skew 500 ppm
Aug 12 06:23:42 dist-test-slave-gjrz krb5kdc[331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515822, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:42.062966 350 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:23:42.063410 350 webserver.cc:460] Webserver started at http://127.30.15.126:37629/ using document root <none> and password file <none>
I20260812 06:23:42.063632 350 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:42.063679 350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:42.063804 350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:42.064827 350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "b06ab40843264d649337f632a2d35606"
format_stamp: "Formatted at 2026-08-12 06:23:42 on dist-test-slave-gjrz"
server_key: "ca8f255655b4c713503e8c0c0de5f57e"
server_key_iv: "6fd1d146eefa0e6008858dcbb2ed1480"
server_key_version: "encryptionkey@0"
I20260812 06:23:42.065148 350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "b06ab40843264d649337f632a2d35606"
format_stamp: "Formatted at 2026-08-12 06:23:42 on dist-test-slave-gjrz"
server_key: "ca8f255655b4c713503e8c0c0de5f57e"
server_key_iv: "6fd1d146eefa0e6008858dcbb2ed1480"
server_key_version: "encryptionkey@0"
I20260812 06:23:42.066351 350 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:23:42.066968 380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.067119 350 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:42.067200 350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "b06ab40843264d649337f632a2d35606"
format_stamp: "Formatted at 2026-08-12 06:23:42 on dist-test-slave-gjrz"
server_key: "ca8f255655b4c713503e8c0c0de5f57e"
server_key_iv: "6fd1d146eefa0e6008858dcbb2ed1480"
server_key_version: "encryptionkey@0"
I20260812 06:23:42.067288 350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:42.090951 350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:42.092701 350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:42.092824 350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:42.097244 350 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:41193
I20260812 06:23:42.097317 478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:41193 every 8 connection(s)
I20260812 06:23:42.097599 350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:42.098344 479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:42.100533 479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606: Bootstrap starting.
I20260812 06:23:42.101070 479 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:42.101305 479 log.cc:824] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:42.101936 479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606: No bootstrap required, opened a new log
I20260812 06:23:42.103557 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 350
I20260812 06:23:42.103641 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:42.103778 30781 external_mini_cluster.cc:1428] Setting key e0a50f7c7f9eed397a14a62627cfdf54
I20260812 06:23:42.104573 479 raft_consensus.cc:348] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06ab40843264d649337f632a2d35606" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41193 } }
I20260812 06:23:42.104725 479 raft_consensus.cc:374] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:42.104760 479 raft_consensus.cc:729] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06ab40843264d649337f632a2d35606, State: Initialized, Role: FOLLOWER
I20260812 06:23:42.104884 479 consensus_queue.cc:260] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06ab40843264d649337f632a2d35606" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41193 } }
I20260812 06:23:42.104969 479 raft_consensus.cc:388] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:42.105008 479 raft_consensus.cc:482] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:42.105057 479 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:42.105683 479 raft_consensus.cc:504] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06ab40843264d649337f632a2d35606" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41193 } }
I20260812 06:23:42.105798 479 leader_election.cc:302] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b06ab40843264d649337f632a2d35606; no voters:
I20260812 06:23:42.105949 479 leader_election.cc:288] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:42.105997 491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:42.106134 491 raft_consensus.cc:686] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [term 1 LEADER]: Becoming Leader. State: Replica: b06ab40843264d649337f632a2d35606, State: Running, Role: LEADER
I20260812 06:23:42.106236 479 sys_catalog.cc:564] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:42.106218 491 consensus_queue.cc:237] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06ab40843264d649337f632a2d35606" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41193 } }
I20260812 06:23:42.106537 491 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b06ab40843264d649337f632a2d35606. Latest consensus state: current_term: 1 leader_uuid: "b06ab40843264d649337f632a2d35606" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06ab40843264d649337f632a2d35606" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41193 } } }
I20260812 06:23:42.106602 491 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:42.106555 495 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b06ab40843264d649337f632a2d35606" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06ab40843264d649337f632a2d35606" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41193 } } }
I20260812 06:23:42.106765 495 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:42.106789 505 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:42.107416 505 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:42.109133 505 catalog_manager.cc:1347] Generated new cluster ID: 1b6089ac7ed641dba8b1f56f70315990
I20260812 06:23:42.109189 505 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:23:42 dist-test-slave-gjrz krb5kdc[331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:42.113806 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.104263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56902 (local address 127.30.15.126:41193)
0812 06:23:42.104428 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.104436 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.104460 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:23:42.104562 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.104568 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.104610 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.104713 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:42.105476 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.106757 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.107895 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.108507 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.108623 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.110832 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:42.110837 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:42.110837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:42.110848 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:42.112411 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.112736 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.112739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.112739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.112834 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.113022 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.113023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.113024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.113257 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:42.113419 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.113498 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.113633 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":72,"threads_started":1}
I20260812 06:23:42.125231 505 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:42.125713 505 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:42.134572 505 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606: Generated new TSK 0
I20260812 06:23:42.134729 505 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:23:42.163539 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41193
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:46261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:42.242965 533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:42.243151 533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:42.243173 533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:42.244298 533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:42.244339 533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:42.244359 533 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:23:42.244388 533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:23:42.245777 533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:46261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.15.126:41193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:42.245990 533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:42.246194 533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:23:42.250962 533 server_base.cc:1034] running on GCE node
W20260812 06:23:42.250913 552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:42.250916 547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:42.251015 548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:42.251344 533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:42.251581 533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:42.252719 533 hybrid_clock.cc:648] HybridClock initialized: now 1786515822252707 us; error 29 us; skew 500 ppm
Aug 12 06:23:42 dist-test-slave-gjrz krb5kdc[331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515822, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:42.255142 533 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:23:42.255542 533 webserver.cc:460] Webserver started at http://127.30.15.65:39401/ using document root <none> and password file <none>
I20260812 06:23:42.255709 533 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:42.255746 533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:42.255834 533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:42.256765 533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "6ce5adba33eb486885f1dd500cac4f4e"
format_stamp: "Formatted at 2026-08-12 06:23:42 on dist-test-slave-gjrz"
server_key: "750ad8296b232e57cf2fad1955265df4"
server_key_iv: "6be82a85fda6af1e5a7b836e343a90f2"
server_key_version: "encryptionkey@0"
I20260812 06:23:42.257061 533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "6ce5adba33eb486885f1dd500cac4f4e"
format_stamp: "Formatted at 2026-08-12 06:23:42 on dist-test-slave-gjrz"
server_key: "750ad8296b232e57cf2fad1955265df4"
server_key_iv: "6be82a85fda6af1e5a7b836e343a90f2"
server_key_version: "encryptionkey@0"
I20260812 06:23:42.258224 533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:23:42.258908 565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.259083 533 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:23:42.259167 533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "6ce5adba33eb486885f1dd500cac4f4e"
format_stamp: "Formatted at 2026-08-12 06:23:42 on dist-test-slave-gjrz"
server_key: "750ad8296b232e57cf2fad1955265df4"
server_key_iv: "6be82a85fda6af1e5a7b836e343a90f2"
server_key_version: "encryptionkey@0"
I20260812 06:23:42.259222 533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:42.266891 533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:42.268501 533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:42.268607 533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:42.269034 533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:42.269069 533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.269088 533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:42.269099 533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.275259 533 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:38925
I20260812 06:23:42.275346 794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:38925 every 8 connection(s)
Aug 12 06:23:42 dist-test-slave-gjrz krb5kdc[331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515822, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:42.275662 533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:23:42.277899 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 533
I20260812 06:23:42.277999 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:23:42.278180 30781 external_mini_cluster.cc:1428] Setting key 5f20f2034109047de50587337f0c77de
I20260812 06:23:42.278496 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.269425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:56425 (local address 127.30.15.126:41193)
0812 06:23:42.269489 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.269491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.269650 (+ 159us) server_negotiation.cc:407] Connection header received
0812 06:23:42.270086 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.270087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.270103 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.270181 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:42.270958 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.271742 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.273172 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.273470 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.273545 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.275985 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:42.275987 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:42.275987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:42.275995 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:42.277266 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.277597 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.277597 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.277598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.277642 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.277830 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.277831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.277832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.277972 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:42.278038 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.278320 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.278406 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:23:42.278636 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.269367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41193 (local address 127.30.15.65:56425)
0812 06:23:42.269510 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:42.269547 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:42.269987 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:42.270229 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:42.270232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:42.270548 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:42.270858 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.270865 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.271829 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.271830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.273082 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.273085 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.273565 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.273566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.273701 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.274155 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:42.274165 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:42.275877 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:42.277332 (+ 1455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.277335 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.277337 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.277532 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.277685 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.277686 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.277686 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.277767 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.278057 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:42.278064 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:42.278191 (+ 127us) client_negotiation.cc:769] Sending connection context
0812 06:23:42.278292 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 06:23:42.278437 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":69,"threads_started":1}
I20260812 06:23:42.279120 796 heartbeater.cc:347] Connected to a master server at 127.30.15.126:41193
I20260812 06:23:42.279199 796 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:42.279397 796 heartbeater.cc:511] Master 127.30.15.126:41193 requested a full tablet report, sending...
I20260812 06:23:42.279889 407 ts_manager.cc:194] Registered new tserver with Master: 6ce5adba33eb486885f1dd500cac4f4e (127.30.15.65:38925)
I20260812 06:23:42.280658 407 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:56425
I20260812 06:23:42.286211 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.281005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:43921 (local address 127.30.15.126:41193)
0812 06:23:42.281052 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.281054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.281247 (+ 193us) server_negotiation.cc:407] Connection header received
0812 06:23:42.281290 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.281291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.281300 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.281356 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:42.281724 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.282192 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.282841 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.283044 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.283096 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.284036 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:42.284038 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:42.284038 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:42.284054 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:42.285177 (+ 1123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.285593 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.285594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.285594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.285642 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.285818 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.285818 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.285818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.285902 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:42.285943 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.286099 (+ 156us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.286156 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:23:42.286274 813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.280959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41193 (local address 127.30.15.65:43921)
0812 06:23:42.281172 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:42.281183 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:42.281245 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:42.281361 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:42.281361 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:42.281560 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:42.281628 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.281630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.282281 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.282282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.282771 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.282773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.283102 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.283103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.283177 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.283558 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:42.283563 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:42.283958 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:42.285311 (+ 1353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.285312 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.285313 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.285514 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.285698 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.285699 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.285699 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.285765 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.285951 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:42.285952 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:42.286010 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 06:23:42.286084 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:23:42.286178 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":158,"threads_started":1}
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:23:42.303205 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41193
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:46261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:42.382952 815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:42.383155 815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:42.383188 815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:42.384359 815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:42.384402 815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:42.384428 815 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:23:42.384452 815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:23:42.385866 815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:46261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.15.126:41193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:42.386113 815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:42.386317 815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:42.390975 835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:42.390987 826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:42.390936 831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:42.391121 815 server_base.cc:1034] running on GCE node
I20260812 06:23:42.391393 815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:42.391621 815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:42.392745 815 hybrid_clock.cc:648] HybridClock initialized: now 1786515822392735 us; error 26 us; skew 500 ppm
Aug 12 06:23:42 dist-test-slave-gjrz krb5kdc[331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515822, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:42.394980 815 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:23:42.395406 815 webserver.cc:460] Webserver started at http://127.30.15.66:42981/ using document root <none> and password file <none>
I20260812 06:23:42.395629 815 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:42.395673 815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:42.395797 815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:42.396786 815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "b6534242371749649d9400951224a517"
format_stamp: "Formatted at 2026-08-12 06:23:42 on dist-test-slave-gjrz"
server_key: "75127b60ef5edcc5733c8c58f45654cb"
server_key_iv: "d7797b2752ea5a25ca6ab72167284388"
server_key_version: "encryptionkey@0"
I20260812 06:23:42.397115 815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "b6534242371749649d9400951224a517"
format_stamp: "Formatted at 2026-08-12 06:23:42 on dist-test-slave-gjrz"
server_key: "75127b60ef5edcc5733c8c58f45654cb"
server_key_iv: "d7797b2752ea5a25ca6ab72167284388"
server_key_version: "encryptionkey@0"
I20260812 06:23:42.398275 815 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:23:42.398902 851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.399050 815 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:42.399132 815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "b6534242371749649d9400951224a517"
format_stamp: "Formatted at 2026-08-12 06:23:42 on dist-test-slave-gjrz"
server_key: "75127b60ef5edcc5733c8c58f45654cb"
server_key_iv: "d7797b2752ea5a25ca6ab72167284388"
server_key_version: "encryptionkey@0"
I20260812 06:23:42.399183 815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:42.408991 815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:42.410511 815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:42.410614 815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:42.411031 815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:42.411067 815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.411087 815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:42.411098 815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.417373 815 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:39781
Aug 12 06:23:42 dist-test-slave-gjrz krb5kdc[331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515822, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:42.417449 1085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:39781 every 8 connection(s)
I20260812 06:23:42.417699 815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:23:42.420264 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.411474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:55819 (local address 127.30.15.126:41193)
0812 06:23:42.411535 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.411538 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.411722 (+ 184us) server_negotiation.cc:407] Connection header received
0812 06:23:42.412211 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.412213 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.412226 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.412277 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:42.413032 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.413776 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.415220 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.415550 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.415625 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.417919 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:42.417921 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:42.417922 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:42.417930 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:42.418990 (+ 1060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.419374 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.419375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.419376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.419437 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.419665 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.419666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.419666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.419781 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:42.419837 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.420093 (+ 256us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.420174 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:23:42.420399 871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.411453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41193 (local address 127.30.15.66:55819)
0812 06:23:42.411616 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:42.411653 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:42.412119 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:42.412340 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:42.412345 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:42.412648 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:42.412906 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.412913 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.413875 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.413876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.415116 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.415120 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.415637 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.415638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.415758 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.416205 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:42.416214 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:42.417826 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:42.419065 (+ 1239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.419072 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.419074 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.419314 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.419490 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.419491 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.419491 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.419606 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.419838 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:42.419845 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:42.419972 (+ 127us) client_negotiation.cc:769] Sending connection context
0812 06:23:42.420057 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:23:42.420203 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":99,"threads_started":1}
I20260812 06:23:42.420845 1086 heartbeater.cc:347] Connected to a master server at 127.30.15.126:41193
I20260812 06:23:42.420922 1086 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:42.421085 1086 heartbeater.cc:511] Master 127.30.15.126:41193 requested a full tablet report, sending...
I20260812 06:23:42.421444 409 ts_manager.cc:194] Registered new tserver with Master: b6534242371749649d9400951224a517 (127.30.15.66:39781)
I20260812 06:23:42.421939 409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:55819
I20260812 06:23:42.426239 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.421775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:57679 (local address 127.30.15.126:41193)
0812 06:23:42.421812 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.421814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.421862 (+ 48us) server_negotiation.cc:407] Connection header received
0812 06:23:42.421938 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.421939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.421946 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.421986 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:42.422288 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.422894 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.423567 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.423736 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.423782 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.424495 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:42.424495 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:42.424496 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:42.424499 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:42.425468 (+ 969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.425729 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.425729 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.425729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.425772 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.425880 (+ 108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.425880 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.425880 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.425993 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:42.426037 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.426130 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.426185 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:23:42.426251 1097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.421699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41193 (local address 127.30.15.66:57679)
0812 06:23:42.421808 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:42.421818 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:42.421887 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:42.421994 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:42.421995 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:42.422178 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:42.422234 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.422236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.422966 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.422967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.423505 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.423506 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.423785 (+ 279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.423785 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.423834 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.424189 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:42.424194 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:42.424437 (+ 243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:42.425529 (+ 1092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.425530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.425530 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.425677 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.425809 (+ 132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.425809 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.425809 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.425850 (+ 41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.426035 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:42.426036 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:42.426070 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 06:23:42.426114 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:23:42.426185 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":59,"threads_started":1}
I20260812 06:23:42.427431 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 815
I20260812 06:23:42.427505 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:23:42.427683 30781 external_mini_cluster.cc:1428] Setting key 5f38514ac574f6ef5916a672de7c7ee1
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:23:42.450819 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41193
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:46261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:42.530532 1103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:42.530701 1103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:42.530723 1103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:42.531853 1103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:42.531890 1103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:42.531910 1103 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:23:42.531940 1103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:23:42.533315 1103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:46261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.15.126:41193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:42.533514 1103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:42.533712 1103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:42.538273 1114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:42.538319 1109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:42.538389 1103 server_base.cc:1034] running on GCE node
W20260812 06:23:42.538450 1111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:42.538638 1103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:42.538863 1103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:42.539994 1103 hybrid_clock.cc:648] HybridClock initialized: now 1786515822539989 us; error 30 us; skew 500 ppm
Aug 12 06:23:42 dist-test-slave-gjrz krb5kdc[331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515822, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:42.542230 1103 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:23:42.542618 1103 webserver.cc:460] Webserver started at http://127.30.15.67:46501/ using document root <none> and password file <none>
I20260812 06:23:42.542801 1103 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:42.542838 1103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:42.542924 1103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:42.543877 1103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "2113ef4a18c5470a96c6a8d3df872c75"
format_stamp: "Formatted at 2026-08-12 06:23:42 on dist-test-slave-gjrz"
server_key: "12c2aa825c42858593f0717aea9653a6"
server_key_iv: "d5e8449781cfa4103b54f2d43d38643b"
server_key_version: "encryptionkey@0"
I20260812 06:23:42.544170 1103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "2113ef4a18c5470a96c6a8d3df872c75"
format_stamp: "Formatted at 2026-08-12 06:23:42 on dist-test-slave-gjrz"
server_key: "12c2aa825c42858593f0717aea9653a6"
server_key_iv: "d5e8449781cfa4103b54f2d43d38643b"
server_key_version: "encryptionkey@0"
I20260812 06:23:42.545260 1103 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:23:42.545861 1124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.545996 1103 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:42.546077 1103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "2113ef4a18c5470a96c6a8d3df872c75"
format_stamp: "Formatted at 2026-08-12 06:23:42 on dist-test-slave-gjrz"
server_key: "12c2aa825c42858593f0717aea9653a6"
server_key_iv: "d5e8449781cfa4103b54f2d43d38643b"
server_key_version: "encryptionkey@0"
I20260812 06:23:42.546141 1103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:42.555905 1103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:42.557410 1103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:42.557524 1103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:42.558029 1103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:42.558087 1103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.558109 1103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:42.558133 1103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:23:42 dist-test-slave-gjrz krb5kdc[331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515822, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:42.565487 1103 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:38183
I20260812 06:23:42.565640 1368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:38183 every 8 connection(s)
I20260812 06:23:42.565871 1103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:23:42.568724 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.558375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:53263 (local address 127.30.15.126:41193)
0812 06:23:42.558424 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.558426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.558645 (+ 219us) server_negotiation.cc:407] Connection header received
0812 06:23:42.559206 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.559208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.559218 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.559278 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:42.560062 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.560556 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.561997 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.562208 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.562271 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.565064 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:42.565065 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:42.565066 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:42.565072 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:42.567090 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.567679 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.567680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.567681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.567747 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.568026 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.568027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.568027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.568150 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:42.568206 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.568552 (+ 346us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.568633 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:23:42.568925 1140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.558350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41193 (local address 127.30.15.67:53263)
0812 06:23:42.558503 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:42.558557 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:42.559105 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:42.559366 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:42.559370 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:42.559702 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:42.559964 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.559971 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.560620 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.560622 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.561908 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.561912 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.562290 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.562291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.562419 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.562852 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:42.562862 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:42.564978 (+ 2116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:42.567169 (+ 2191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.567192 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.567195 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.567589 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.567814 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.567814 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.567815 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.567947 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.568213 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:42.568221 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:42.568407 (+ 186us) client_negotiation.cc:769] Sending connection context
0812 06:23:42.568506 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 06:23:42.568677 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260812 06:23:42.569485 1371 heartbeater.cc:347] Connected to a master server at 127.30.15.126:41193
I20260812 06:23:42.569578 1371 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:42.569752 1371 heartbeater.cc:511] Master 127.30.15.126:41193 requested a full tablet report, sending...
I20260812 06:23:42.570124 407 ts_manager.cc:194] Registered new tserver with Master: 2113ef4a18c5470a96c6a8d3df872c75 (127.30.15.67:38183)
I20260812 06:23:42.570633 407 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:53263
I20260812 06:23:42.575007 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 1103
I20260812 06:23:42.575090 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:23:42.575284 30781 external_mini_cluster.cc:1428] Setting key 38e880a87668afafb9da5b50c0bc798c
I20260812 06:23:42.576107 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:23:42.576346 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.571486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:60761 (local address 127.30.15.126:41193)
0812 06:23:42.571532 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.571534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.571648 (+ 114us) server_negotiation.cc:407] Connection header received
0812 06:23:42.571692 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.571692 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.571700 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.571743 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:42.572033 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.572535 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.573159 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.573328 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.573370 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.574060 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:42.574062 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:42.574062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:42.574068 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:42.575292 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.575631 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.575632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.575632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.575690 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.575843 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.575844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.575844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.575966 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:42.576058 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.576219 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.576285 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:23:42.576368 1382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.570488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41193 (local address 127.30.15.67:60761)
0812 06:23:42.571596 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:42.571606 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:42.571657 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:42.571748 (+ 91us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:42.571749 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:42.571895 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:42.571950 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.571951 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.572608 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.572608 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.573105 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.573106 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.573375 (+ 269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.573376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.573424 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.573732 (+ 308us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:42.573735 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:42.573996 (+ 261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:42.575372 (+ 1376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.575373 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.575373 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.575539 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.575748 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.575749 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.575749 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.575802 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.576051 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:42.576051 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:42.576110 (+ 59us) client_negotiation.cc:769] Sending connection context
0812 06:23:42.576189 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 06:23:42.576279 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1083,"thread_start_us":1027,"threads_started":1}
Aug 12 06:23:42 dist-test-slave-gjrz krb5kdc[331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515822, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:23:42 dist-test-slave-gjrz krb5kdc[331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515822, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:42.597780 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.592099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56912 (local address 127.30.15.126:41193)
0812 06:23:42.592143 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.592145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.592153 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:23:42.592174 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.592175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.592182 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.592226 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:42.592720 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.593160 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.593820 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.593988 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.594029 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.595985 (+ 1956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:42.595987 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:42.595987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:42.595994 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:42.597001 (+ 1007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.597281 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.597281 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.597281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.597323 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.597443 (+ 120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.597444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.597444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.597537 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:42.597603 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.597672 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.597724 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:23:42.599069 407 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56912:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:23:42.600615 407 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:23:42.606582 1404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.602421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:38925 (local address 127.0.0.1:55274)
0812 06:23:42.602698 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:42.602790 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:42.602862 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:42.603039 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:42.603042 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:42.603044 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:42.603104 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.603105 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.604212 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.604213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.605290 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.605293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.606318 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.606319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.606379 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.606389 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 06:23:42.606445 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 06:23:42.606495 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":48,"threads_started":1}
I20260812 06:23:42.606719 1400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.602421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:38183 (local address 127.0.0.1:40234)
0812 06:23:42.602803 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:42.602813 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:42.603011 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:42.603238 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:42.603238 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:42.603240 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:42.603326 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.603328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.604707 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.604707 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.605662 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.605664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.606454 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.606454 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.606506 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.606509 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:23:42.606616 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 06:23:42.606652 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":24,"thread_start_us":45,"threads_started":1}
I20260812 06:23:42.606905 1405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.602587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55274 (local address 127.30.15.65:38925)
0812 06:23:42.602752 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.602757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.602855 (+ 98us) server_negotiation.cc:407] Connection header received
0812 06:23:42.602943 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.602946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.602960 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.603032 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:42.603188 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.604132 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.605414 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.606168 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.606230 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.606283 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.606766 (+ 483us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.606813 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":111,"threads_started":1}
I20260812 06:23:42.606917 1403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.602481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40234 (local address 127.30.15.67:38183)
0812 06:23:42.602619 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.602623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.602874 (+ 251us) server_negotiation.cc:407] Connection header received
0812 06:23:42.603149 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.603151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.603168 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.603241 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:42.603413 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.604617 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.605734 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.606374 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.606443 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.606493 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.606717 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.606825 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
I20260812 06:23:42.607533 662 tablet_service.cc:1467] Processing CreateTablet for tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f (DEFAULT_TABLE table=test-table [id=fb97817dc6624b919ede330e2f166cb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:42.607579 1231 tablet_service.cc:1467] Processing CreateTablet for tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f (DEFAULT_TABLE table=test-table [id=fb97817dc6624b919ede330e2f166cb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:42.607813 1415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.602790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44118 (local address 127.30.15.66:39781)
0812 06:23:42.602975 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.602980 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.602988 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:23:42.603029 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.603031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.603046 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.603139 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:42.603447 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.604585 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.605992 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.607392 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.607463 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.607526 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.607683 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.607723 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":75,"threads_started":1}
I20260812 06:23:42.607945 1231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:42.607947 662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:42.607957 1401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.602597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:39781 (local address 127.0.0.1:44118)
0812 06:23:42.602913 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:42.602921 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:42.602963 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:42.603331 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:42.603332 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:42.603334 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:42.603365 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.603366 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.604675 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.604676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.605907 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.605910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.607493 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.607495 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.607565 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.607569 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:23:42.607628 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:23:42.607708 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":25,"thread_start_us":44,"threads_started":1}
I20260812 06:23:42.608575 942 tablet_service.cc:1467] Processing CreateTablet for tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f (DEFAULT_TABLE table=test-table [id=fb97817dc6624b919ede330e2f166cb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:42.608886 942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:42.610792 1421 tablet_bootstrap.cc:492] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e: Bootstrap starting.
I20260812 06:23:42.611407 1421 tablet_bootstrap.cc:654] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:42.611665 1421 log.cc:824] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:42.611945 1422 tablet_bootstrap.cc:492] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75: Bootstrap starting.
I20260812 06:23:42.612366 1426 tablet_bootstrap.cc:492] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517: Bootstrap starting.
I20260812 06:23:42.612514 1421 tablet_bootstrap.cc:492] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e: No bootstrap required, opened a new log
I20260812 06:23:42.612578 1421 ts_tablet_manager.cc:1397] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:23:42.612772 1422 tablet_bootstrap.cc:654] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:42.613013 1426 tablet_bootstrap.cc:654] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:42.613139 1422 log.cc:824] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:42.613349 1426 log.cc:824] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:42.613986 1422 tablet_bootstrap.cc:492] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75: No bootstrap required, opened a new log
I20260812 06:23:42.614040 1422 ts_tablet_manager.cc:1397] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:23:42.614133 1426 tablet_bootstrap.cc:492] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517: No bootstrap required, opened a new log
I20260812 06:23:42.614238 1426 ts_tablet_manager.cc:1397] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:23:42.614465 1421 raft_consensus.cc:348] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } }
I20260812 06:23:42.614631 1421 raft_consensus.cc:374] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:42.614672 1421 raft_consensus.cc:729] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ce5adba33eb486885f1dd500cac4f4e, State: Initialized, Role: FOLLOWER
I20260812 06:23:42.614787 1421 consensus_queue.cc:260] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } }
I20260812 06:23:42.615061 1421 ts_tablet_manager.cc:1428] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 06:23:42.615103 796 heartbeater.cc:503] Master 127.30.15.126:41193 was elected leader, sending a full tablet report...
I20260812 06:23:42.615795 1422 raft_consensus.cc:348] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } }
I20260812 06:23:42.615955 1422 raft_consensus.cc:374] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:42.615995 1422 raft_consensus.cc:729] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2113ef4a18c5470a96c6a8d3df872c75, State: Initialized, Role: FOLLOWER
I20260812 06:23:42.616119 1422 consensus_queue.cc:260] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } }
I20260812 06:23:42.616384 1422 ts_tablet_manager.cc:1428] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:23:42.616298 1426 raft_consensus.cc:348] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } }
I20260812 06:23:42.616460 1371 heartbeater.cc:503] Master 127.30.15.126:41193 was elected leader, sending a full tablet report...
I20260812 06:23:42.616452 1426 raft_consensus.cc:374] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:42.616503 1426 raft_consensus.cc:729] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6534242371749649d9400951224a517, State: Initialized, Role: FOLLOWER
I20260812 06:23:42.616614 1426 consensus_queue.cc:260] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } }
I20260812 06:23:42.616854 1426 ts_tablet_manager.cc:1428] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:23:42.616925 1086 heartbeater.cc:503] Master 127.30.15.126:41193 was elected leader, sending a full tablet report...
I20260812 06:23:42.652115 1430 raft_consensus.cc:482] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:23:42.652222 1430 raft_consensus.cc:504] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } }
I20260812 06:23:42.652524 1430 leader_election.cc:288] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2113ef4a18c5470a96c6a8d3df872c75 (127.30.15.67:38183), b6534242371749649d9400951224a517 (127.30.15.66:39781)
I20260812 06:23:42.655349 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.652701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:39781 (local address 127.30.15.65:35681)
0812 06:23:42.652753 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:42.652765 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:42.652805 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:42.653024 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:42.653026 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:42.653028 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:42.653112 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.653114 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.653728 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.653729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.654606 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.654609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.655093 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.655094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.655183 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.655186 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:23:42.655224 (+ 38us) client_negotiation.cc:240] Negotiation successful
0812 06:23:42.655256 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260812 06:23:42.655375 1415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.652835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:35681 (local address 127.30.15.66:39781)
0812 06:23:42.652893 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.652894 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.652902 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:23:42.652925 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.652926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.652934 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.652979 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:42.653182 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.653665 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.654685 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.655025 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.655079 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.655086 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.655246 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.655309 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:23:42.655697 980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27fe9d5f2c4a4a56a9a87ef735cc5a9f" candidate_uuid: "6ce5adba33eb486885f1dd500cac4f4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6534242371749649d9400951224a517" is_pre_election: true
I20260812 06:23:42.655835 980 raft_consensus.cc:2454] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ce5adba33eb486885f1dd500cac4f4e in term 0.
I20260812 06:23:42.656000 1434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.652701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:38183 (local address 127.30.15.65:34797)
0812 06:23:42.652848 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:42.652858 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:42.652924 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:42.653037 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:42.653038 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:42.653039 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:42.653114 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.653115 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.654234 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.654235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.655067 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.655070 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.655731 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.655732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.655792 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.655796 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:23:42.655875 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 06:23:42.655912 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":15,"thread_start_us":81,"threads_started":1}
I20260812 06:23:42.656018 1403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.652747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:34797 (local address 127.30.15.67:38183)
0812 06:23:42.652796 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.652797 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.652921 (+ 124us) server_negotiation.cc:407] Connection header received
0812 06:23:42.652990 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.652991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.653000 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.653036 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:42.653743 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.654165 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.655151 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.655639 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.655718 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.655727 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.655900 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.655942 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:23:42.656100 572 leader_election.cc:302] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ce5adba33eb486885f1dd500cac4f4e, b6534242371749649d9400951224a517; no voters:
I20260812 06:23:42.656220 1430 raft_consensus.cc:2781] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:23:42.656270 1430 raft_consensus.cc:482] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:23:42.656293 1430 raft_consensus.cc:3037] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:42.656374 1272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27fe9d5f2c4a4a56a9a87ef735cc5a9f" candidate_uuid: "6ce5adba33eb486885f1dd500cac4f4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2113ef4a18c5470a96c6a8d3df872c75" is_pre_election: true
I20260812 06:23:42.656464 1272 raft_consensus.cc:2454] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ce5adba33eb486885f1dd500cac4f4e in term 0.
I20260812 06:23:42.657231 1430 raft_consensus.cc:504] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } }
I20260812 06:23:42.657341 1430 leader_election.cc:288] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [CANDIDATE]: Term 1 election: Requested vote from peers 2113ef4a18c5470a96c6a8d3df872c75 (127.30.15.67:38183), b6534242371749649d9400951224a517 (127.30.15.66:39781)
I20260812 06:23:42.657502 1272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27fe9d5f2c4a4a56a9a87ef735cc5a9f" candidate_uuid: "6ce5adba33eb486885f1dd500cac4f4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2113ef4a18c5470a96c6a8d3df872c75"
I20260812 06:23:42.657531 980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27fe9d5f2c4a4a56a9a87ef735cc5a9f" candidate_uuid: "6ce5adba33eb486885f1dd500cac4f4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6534242371749649d9400951224a517"
I20260812 06:23:42.657575 1272 raft_consensus.cc:3037] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:42.657596 980 raft_consensus.cc:3037] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:42.658217 1272 raft_consensus.cc:2454] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ce5adba33eb486885f1dd500cac4f4e in term 1.
I20260812 06:23:42.658273 980 raft_consensus.cc:2454] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ce5adba33eb486885f1dd500cac4f4e in term 1.
I20260812 06:23:42.658416 571 leader_election.cc:302] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2113ef4a18c5470a96c6a8d3df872c75, 6ce5adba33eb486885f1dd500cac4f4e; no voters:
I20260812 06:23:42.658557 1430 raft_consensus.cc:2781] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:42.658694 1430 raft_consensus.cc:686] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 1 LEADER]: Becoming Leader. State: Replica: 6ce5adba33eb486885f1dd500cac4f4e, State: Running, Role: LEADER
I20260812 06:23:42.658767 1430 consensus_queue.cc:237] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } }
I20260812 06:23:42.659472 407 catalog_manager.cc:5495] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ce5adba33eb486885f1dd500cac4f4e (127.30.15.65). New cstate: current_term: 1 leader_uuid: "6ce5adba33eb486885f1dd500cac4f4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } health_report { overall_health: UNKNOWN } } }
I20260812 06:23:42.667475 1405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.665211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55278 (local address 127.30.15.65:38925)
0812 06:23:42.665264 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.665266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.665274 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:23:42.665361 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.665361 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.665376 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.665428 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:42.665564 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.665991 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.666725 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.666902 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.666952 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.667142 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:42.667228 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:42.667345 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.667394 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.667415 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260812 06:23:42.668188 1087 tablet.cc:2369] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:23:42.668993 980 raft_consensus.cc:1261] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517 [term 1 FOLLOWER]: Refusing update from remote peer 6ce5adba33eb486885f1dd500cac4f4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:42.668999 1272 raft_consensus.cc:1261] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75 [term 1 FOLLOWER]: Refusing update from remote peer 6ce5adba33eb486885f1dd500cac4f4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:42.669305 1435 consensus_queue.cc:1035] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:42.669416 1430 consensus_queue.cc:1035] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:42.671875 1446 mvcc.cc:205] Tried to move back new op lower bound from 7317568809649979392 to 7317568809610813440. Current Snapshot: MvccSnapshot[applied={T|T < 7317568809649979392}]
I20260812 06:23:42.672103 1443 mvcc.cc:205] Tried to move back new op lower bound from 7317568809649979392 to 7317568809610813440. Current Snapshot: MvccSnapshot[applied={T|T < 7317568809649979392}]
I20260812 06:23:42.672385 1438 mvcc.cc:205] Tried to move back new op lower bound from 7317568809649979392 to 7317568809610813440. Current Snapshot: MvccSnapshot[applied={T|T < 7317568809649979392}]
I20260812 06:23:42.675231 407 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:42.675331 407 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:42.675987 407 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606: Sending DeleteTablet for 3 replicas of tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f
I20260812 06:23:42.676314 662 tablet_service.cc:1514] Processing DeleteTablet for tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:42 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:55274
I20260812 06:23:42.676379 1231 tablet_service.cc:1514] Processing DeleteTablet for tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:42 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:40234
I20260812 06:23:42.676379 942 tablet_service.cc:1514] Processing DeleteTablet for tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:42 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:44118
I20260812 06:23:42.676781 1462 tablet_replica.cc:330] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517: stopping tablet replica
I20260812 06:23:42.676786 407 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56912:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 06:23:42.676877 1462 raft_consensus.cc:2229] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 06:23:42.676931 407 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:23:42.676997 1462 raft_consensus.cc:2258] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:42.677306 1460 tablet_replica.cc:330] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75: stopping tablet replica
I20260812 06:23:42.677383 1462 ts_tablet_manager.cc:1905] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:42.678181 1460 raft_consensus.cc:2229] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:42.678298 1460 raft_consensus.cc:2258] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:42.678709 1460 ts_tablet_manager.cc:1905] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:42.678951 1462 ts_tablet_manager.cc:1918] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:23:42.679024 1462 log.cc:1196] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/27fe9d5f2c4a4a56a9a87ef735cc5a9f
I20260812 06:23:42.679308 1462 ts_tablet_manager.cc:1939] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P b6534242371749649d9400951224a517: Deleting consensus metadata
I20260812 06:23:42.679735 386 catalog_manager.cc:4841] TS b6534242371749649d9400951224a517 (127.30.15.66:39781): tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f (table test-table [id=fb97817dc6624b919ede330e2f166cb9]) successfully deleted
I20260812 06:23:42.680675 1231 tablet_service.cc:1467] Processing CreateTablet for tablet d8cb43d411fc4b3eb926658eb501dafe (DEFAULT_TABLE table=test-table [id=9c7e8fe4ebb142bfaa4d50834805af11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:42.680786 1231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8cb43d411fc4b3eb926658eb501dafe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:42.681181 1460 ts_tablet_manager.cc:1918] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:23:42.681255 1460 log.cc:1196] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/27fe9d5f2c4a4a56a9a87ef735cc5a9f
I20260812 06:23:42.681789 1422 tablet_bootstrap.cc:492] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75: Bootstrap starting.
I20260812 06:23:42.681962 662 tablet_service.cc:1467] Processing CreateTablet for tablet d8cb43d411fc4b3eb926658eb501dafe (DEFAULT_TABLE table=test-table [id=9c7e8fe4ebb142bfaa4d50834805af11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:42.682022 942 tablet_service.cc:1467] Processing CreateTablet for tablet d8cb43d411fc4b3eb926658eb501dafe (DEFAULT_TABLE table=test-table [id=9c7e8fe4ebb142bfaa4d50834805af11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:42.682076 662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8cb43d411fc4b3eb926658eb501dafe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:42.682121 942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8cb43d411fc4b3eb926658eb501dafe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:42.682247 1422 tablet_bootstrap.cc:654] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:42.683111 1426 tablet_bootstrap.cc:492] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517: Bootstrap starting.
I20260812 06:23:42.683403 1421 tablet_bootstrap.cc:492] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e: Bootstrap starting.
I20260812 06:23:42.681795 1460 ts_tablet_manager.cc:1939] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 2113ef4a18c5470a96c6a8d3df872c75: Deleting consensus metadata
I20260812 06:23:42.683568 1426 tablet_bootstrap.cc:654] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:42.683806 1421 tablet_bootstrap.cc:654] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:42.684166 385 catalog_manager.cc:4841] TS 2113ef4a18c5470a96c6a8d3df872c75 (127.30.15.67:38183): tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f (table test-table [id=fb97817dc6624b919ede330e2f166cb9]) successfully deleted
I20260812 06:23:42.684396 1422 tablet_bootstrap.cc:492] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75: No bootstrap required, opened a new log
I20260812 06:23:42.684448 1422 ts_tablet_manager.cc:1397] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 06:23:42.684587 1421 tablet_bootstrap.cc:492] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e: No bootstrap required, opened a new log
I20260812 06:23:42.684592 1422 raft_consensus.cc:348] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.684638 1421 ts_tablet_manager.cc:1397] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:23:42.684651 1422 raft_consensus.cc:374] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:42.684670 1422 raft_consensus.cc:729] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2113ef4a18c5470a96c6a8d3df872c75, State: Initialized, Role: FOLLOWER
I20260812 06:23:42.684710 1422 consensus_queue.cc:260] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.684794 1422 ts_tablet_manager.cc:1428] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.684790 1421 raft_consensus.cc:348] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.684857 1421 raft_consensus.cc:374] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:42.684882 1421 raft_consensus.cc:729] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ce5adba33eb486885f1dd500cac4f4e, State: Initialized, Role: FOLLOWER
I20260812 06:23:42.684921 1421 consensus_queue.cc:260] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.685010 1421 ts_tablet_manager.cc:1428] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.685453 1426 tablet_bootstrap.cc:492] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517: No bootstrap required, opened a new log
I20260812 06:23:42.685508 1426 ts_tablet_manager.cc:1397] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:23:42.685657 1426 raft_consensus.cc:348] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.685722 1426 raft_consensus.cc:374] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:42.685739 1426 raft_consensus.cc:729] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6534242371749649d9400951224a517, State: Initialized, Role: FOLLOWER
I20260812 06:23:42.685784 1426 consensus_queue.cc:260] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.685875 1426 ts_tablet_manager.cc:1428] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:42.686064 1458 tablet_replica.cc:330] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e: stopping tablet replica
I20260812 06:23:42.686156 1458 raft_consensus.cc:2229] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:23:42.686270 1458 raft_consensus.cc:2258] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:42.686801 1458 ts_tablet_manager.cc:1905] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:42.687987 1458 ts_tablet_manager.cc:1918] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:23:42.688051 1458 log.cc:1196] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/wal/wals/27fe9d5f2c4a4a56a9a87ef735cc5a9f
I20260812 06:23:42.688237 1458 ts_tablet_manager.cc:1939] T 27fe9d5f2c4a4a56a9a87ef735cc5a9f P 6ce5adba33eb486885f1dd500cac4f4e: Deleting consensus metadata
I20260812 06:23:42.688566 386 catalog_manager.cc:4841] TS 6ce5adba33eb486885f1dd500cac4f4e (127.30.15.65:38925): tablet 27fe9d5f2c4a4a56a9a87ef735cc5a9f (table test-table [id=fb97817dc6624b919ede330e2f166cb9]) successfully deleted
W20260812 06:23:42.776398 798 tablet.cc:2369] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:23:42.816556 1376 tablet.cc:2369] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:23:42.842523 1452 raft_consensus.cc:482] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:23:42.842612 1452 raft_consensus.cc:504] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.842756 1452 leader_election.cc:288] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6534242371749649d9400951224a517 (127.30.15.66:39781), 2113ef4a18c5470a96c6a8d3df872c75 (127.30.15.67:38183)
I20260812 06:23:42.842939 980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8cb43d411fc4b3eb926658eb501dafe" candidate_uuid: "6ce5adba33eb486885f1dd500cac4f4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6534242371749649d9400951224a517" is_pre_election: true
I20260812 06:23:42.842990 1272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8cb43d411fc4b3eb926658eb501dafe" candidate_uuid: "6ce5adba33eb486885f1dd500cac4f4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2113ef4a18c5470a96c6a8d3df872c75" is_pre_election: true
I20260812 06:23:42.843062 980 raft_consensus.cc:2454] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ce5adba33eb486885f1dd500cac4f4e in term 0.
I20260812 06:23:42.843081 1272 raft_consensus.cc:2454] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ce5adba33eb486885f1dd500cac4f4e in term 0.
I20260812 06:23:42.843221 572 leader_election.cc:302] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ce5adba33eb486885f1dd500cac4f4e, b6534242371749649d9400951224a517; no voters:
I20260812 06:23:42.843367 1452 raft_consensus.cc:2781] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:23:42.843420 1452 raft_consensus.cc:482] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:23:42.843444 1452 raft_consensus.cc:3037] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:42.844152 1452 raft_consensus.cc:504] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.844276 1452 leader_election.cc:288] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [CANDIDATE]: Term 1 election: Requested vote from peers b6534242371749649d9400951224a517 (127.30.15.66:39781), 2113ef4a18c5470a96c6a8d3df872c75 (127.30.15.67:38183)
I20260812 06:23:42.844421 1272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8cb43d411fc4b3eb926658eb501dafe" candidate_uuid: "6ce5adba33eb486885f1dd500cac4f4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2113ef4a18c5470a96c6a8d3df872c75"
I20260812 06:23:42.844499 1272 raft_consensus.cc:3037] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:42.844513 980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8cb43d411fc4b3eb926658eb501dafe" candidate_uuid: "6ce5adba33eb486885f1dd500cac4f4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6534242371749649d9400951224a517"
I20260812 06:23:42.844595 980 raft_consensus.cc:3037] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:42.845160 1272 raft_consensus.cc:2454] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ce5adba33eb486885f1dd500cac4f4e in term 1.
I20260812 06:23:42.845182 980 raft_consensus.cc:2454] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ce5adba33eb486885f1dd500cac4f4e in term 1.
I20260812 06:23:42.845328 571 leader_election.cc:302] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2113ef4a18c5470a96c6a8d3df872c75, 6ce5adba33eb486885f1dd500cac4f4e; no voters:
I20260812 06:23:42.845435 1452 raft_consensus.cc:2781] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:42.845500 1452 raft_consensus.cc:686] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 1 LEADER]: Becoming Leader. State: Replica: 6ce5adba33eb486885f1dd500cac4f4e, State: Running, Role: LEADER
I20260812 06:23:42.845558 1452 consensus_queue.cc:237] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.846110 407 catalog_manager.cc:5495] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ce5adba33eb486885f1dd500cac4f4e (127.30.15.65). New cstate: current_term: 1 leader_uuid: "6ce5adba33eb486885f1dd500cac4f4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } health_report { overall_health: UNKNOWN } } }
Aug 12 06:23:42 dist-test-slave-gjrz krb5kdc[331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515822, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:42.898027 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.891926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56924 (local address 127.30.15.126:41193)
0812 06:23:42.892008 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:42.892011 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:42.892094 (+ 83us) server_negotiation.cc:407] Connection header received
0812 06:23:42.892157 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:42.892158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:42.892167 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:42.892207 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:42.892668 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.893158 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.893825 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.894007 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.894060 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.895988 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:42.895990 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:42.895990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:42.895997 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:42.897201 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.897488 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.897488 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.897488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.897534 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:42.897660 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:42.897661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:42.897661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:42.897752 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:42.897796 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:42.897894 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 06:23:42.897955 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 06:23:42.898129 1483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:42.891867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41193 (local address 127.0.0.1:56924)
0812 06:23:42.892020 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:42.892031 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:42.892101 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:42.892217 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:42.892218 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:42.892542 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:42.892588 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.892592 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.893229 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.893230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.893750 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:42.893752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:42.894066 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:42.894066 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:42.894130 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:42.894567 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:42.894572 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:42.895910 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:42.897261 (+ 1351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.897265 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.897267 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.897438 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.897576 (+ 138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:42.897576 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:42.897576 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:42.897622 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:42.897790 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:42.897794 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:42.897835 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 06:23:42.897878 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:23:42.898011 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":49,"thread_start_us":76,"threads_started":1}
I20260812 06:23:42.899809 407 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:56924:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 06:23:42.899994 407 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:23:42.901304 942 tablet_service.cc:1467] Processing CreateTablet for tablet e9835ba3473e4c95b4b950bc98deb399 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=514e871386f34a41a6e39866458e6af0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:23:42.901301 662 tablet_service.cc:1467] Processing CreateTablet for tablet e9835ba3473e4c95b4b950bc98deb399 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=514e871386f34a41a6e39866458e6af0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:23:42.901301 1231 tablet_service.cc:1467] Processing CreateTablet for tablet e9835ba3473e4c95b4b950bc98deb399 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=514e871386f34a41a6e39866458e6af0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:23:42.901449 662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9835ba3473e4c95b4b950bc98deb399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:42.901450 1231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9835ba3473e4c95b4b950bc98deb399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:42.901455 942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9835ba3473e4c95b4b950bc98deb399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:42.902679 1426 tablet_bootstrap.cc:492] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: Bootstrap starting.
I20260812 06:23:42.902938 1422 tablet_bootstrap.cc:492] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75: Bootstrap starting.
I20260812 06:23:42.903134 1426 tablet_bootstrap.cc:654] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:42.903394 1422 tablet_bootstrap.cc:654] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:42.903715 1421 tablet_bootstrap.cc:492] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e: Bootstrap starting.
I20260812 06:23:42.903831 1426 tablet_bootstrap.cc:492] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: No bootstrap required, opened a new log
I20260812 06:23:42.903882 1426 ts_tablet_manager.cc:1397] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:23:42.904060 1421 tablet_bootstrap.cc:654] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:42.904053 1426 raft_consensus.cc:348] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.904131 1426 raft_consensus.cc:374] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:42.904160 1426 raft_consensus.cc:729] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6534242371749649d9400951224a517, State: Initialized, Role: FOLLOWER
I20260812 06:23:42.904209 1426 consensus_queue.cc:260] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.904304 1426 ts_tablet_manager.cc:1428] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.904376 1433 tablet_replica.cc:439] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } }
I20260812 06:23:42.904470 1433 tablet_replica.cc:442] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:42.904680 1421 tablet_bootstrap.cc:492] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e: No bootstrap required, opened a new log
I20260812 06:23:42.904733 1421 ts_tablet_manager.cc:1397] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:23:42.904846 1421 raft_consensus.cc:348] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.904918 1421 raft_consensus.cc:374] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:42.904938 1421 raft_consensus.cc:729] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ce5adba33eb486885f1dd500cac4f4e, State: Initialized, Role: FOLLOWER
I20260812 06:23:42.904980 1421 consensus_queue.cc:260] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.905063 1421 ts_tablet_manager.cc:1428] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.905153 1452 tablet_replica.cc:439] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } }
I20260812 06:23:42.905210 1452 tablet_replica.cc:442] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:42.905423 1422 tablet_bootstrap.cc:492] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75: No bootstrap required, opened a new log
I20260812 06:23:42.905464 1422 ts_tablet_manager.cc:1397] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260812 06:23:42.905593 1422 raft_consensus.cc:348] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.905666 1422 raft_consensus.cc:374] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:42.905678 1422 raft_consensus.cc:729] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2113ef4a18c5470a96c6a8d3df872c75, State: Initialized, Role: FOLLOWER
I20260812 06:23:42.905722 1422 consensus_queue.cc:260] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:42.905812 1422 ts_tablet_manager.cc:1428] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:42.905879 1431 tablet_replica.cc:439] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } }
I20260812 06:23:42.905992 1431 tablet_replica.cc:442] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:43.025004 1433 raft_consensus.cc:482] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:23:43.025107 1433 raft_consensus.cc:504] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:43.025422 1433 leader_election.cc:288] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ce5adba33eb486885f1dd500cac4f4e (127.30.15.65:38925), 2113ef4a18c5470a96c6a8d3df872c75 (127.30.15.67:38183)
I20260812 06:23:43.028318 1403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:43.025671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:48763 (local address 127.30.15.67:38183)
0812 06:23:43.025722 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:43.025724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:43.025867 (+ 143us) server_negotiation.cc:407] Connection header received
0812 06:23:43.025940 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:43.025941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:43.025950 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:43.026001 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:43.026145 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.026616 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.027641 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.027998 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.028064 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:43.028074 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:43.028216 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 06:23:43.028250 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:23:43.028318 1405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:43.025657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:34965 (local address 127.30.15.65:38925)
0812 06:23:43.025722 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:43.025724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:43.025832 (+ 108us) server_negotiation.cc:407] Connection header received
0812 06:23:43.025870 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:43.025872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:43.025885 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:43.025932 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:43.026091 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.026572 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.027643 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.028004 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.028064 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:43.028074 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:43.028209 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 06:23:43.028249 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:23:43.028357 1502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:43.025585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:38183 (local address 127.30.15.66:48763)
0812 06:23:43.025794 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:43.025803 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:43.025873 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:43.026005 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:43.026006 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:43.026008 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:43.026085 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:43.026086 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.026689 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.026690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:43.027552 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:43.027554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.028086 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.028086 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:43.028157 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:43.028160 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:23:43.028203 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:23:43.028244 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":142,"thread_start_us":66,"threads_started":1}
I20260812 06:23:43.028369 1495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:43.025585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:38925 (local address 127.30.15.66:34965)
0812 06:23:43.025746 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:43.025758 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:43.025823 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:43.025934 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:43.025935 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:43.025937 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:43.026017 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:43.026019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.026644 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.026663 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:43.027560 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:43.027563 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.028082 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.028083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:43.028148 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:43.028151 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:23:43.028196 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:23:43.028239 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":27,"thread_start_us":71,"threads_started":1}
I20260812 06:23:43.028627 1272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9835ba3473e4c95b4b950bc98deb399" candidate_uuid: "b6534242371749649d9400951224a517" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2113ef4a18c5470a96c6a8d3df872c75" is_pre_election: true
I20260812 06:23:43.028728 1272 raft_consensus.cc:2454] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6534242371749649d9400951224a517 in term 0.
I20260812 06:23:43.028795 711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9835ba3473e4c95b4b950bc98deb399" candidate_uuid: "b6534242371749649d9400951224a517" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ce5adba33eb486885f1dd500cac4f4e" is_pre_election: true
I20260812 06:23:43.028889 855 leader_election.cc:302] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2113ef4a18c5470a96c6a8d3df872c75, b6534242371749649d9400951224a517; no voters:
I20260812 06:23:43.028924 711 raft_consensus.cc:2454] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6534242371749649d9400951224a517 in term 0.
I20260812 06:23:43.029016 1433 raft_consensus.cc:2781] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:23:43.029065 1433 raft_consensus.cc:482] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:23:43.029086 1433 raft_consensus.cc:3037] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:43.029776 1433 raft_consensus.cc:504] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:43.029901 1433 leader_election.cc:288] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [CANDIDATE]: Term 1 election: Requested vote from peers 6ce5adba33eb486885f1dd500cac4f4e (127.30.15.65:38925), 2113ef4a18c5470a96c6a8d3df872c75 (127.30.15.67:38183)
I20260812 06:23:43.030102 1272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9835ba3473e4c95b4b950bc98deb399" candidate_uuid: "b6534242371749649d9400951224a517" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2113ef4a18c5470a96c6a8d3df872c75"
I20260812 06:23:43.030143 711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9835ba3473e4c95b4b950bc98deb399" candidate_uuid: "b6534242371749649d9400951224a517" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ce5adba33eb486885f1dd500cac4f4e"
I20260812 06:23:43.030191 1272 raft_consensus.cc:3037] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:43.030210 711 raft_consensus.cc:3037] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:43.030931 1272 raft_consensus.cc:2454] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6534242371749649d9400951224a517 in term 1.
I20260812 06:23:43.030931 711 raft_consensus.cc:2454] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6534242371749649d9400951224a517 in term 1.
I20260812 06:23:43.031087 855 leader_election.cc:302] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2113ef4a18c5470a96c6a8d3df872c75, b6534242371749649d9400951224a517; no voters:
I20260812 06:23:43.031179 1433 raft_consensus.cc:2781] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:43.031312 1433 raft_consensus.cc:686] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [term 1 LEADER]: Becoming Leader. State: Replica: b6534242371749649d9400951224a517, State: Running, Role: LEADER
I20260812 06:23:43.031378 1433 consensus_queue.cc:237] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } }
I20260812 06:23:43.031666 1503 tablet_replica.cc:439] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: TxnStatusTablet state changed. Reason: New leader b6534242371749649d9400951224a517. Latest consensus state: current_term: 1 leader_uuid: "b6534242371749649d9400951224a517" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } }
I20260812 06:23:43.031775 1503 tablet_replica.cc:442] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:23:43.031958 1512 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:23:43.032068 1512 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 06:23:43.032028 409 catalog_manager.cc:5495] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6534242371749649d9400951224a517 (127.30.15.66). New cstate: current_term: 1 leader_uuid: "b6534242371749649d9400951224a517" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } health_report { overall_health: UNKNOWN } } }
I20260812 06:23:43.048923 1415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:43.046283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44124 (local address 127.30.15.66:39781)
0812 06:23:43.046323 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:43.046325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:43.046337 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:23:43.046436 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:43.046436 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:43.046453 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:43.046507 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:43.046638 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.047106 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.048218 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.048404 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.048472 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:43.048643 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:43.048735 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:43.048783 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:43.048848 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 06:23:43.048867 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:23:43.048978 1483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:43.046213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:39781 (local address 127.0.0.1:44124)
0812 06:23:43.046290 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:43.046303 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:43.046355 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:43.046526 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:43.046526 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:43.046528 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:23:43.046580 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:43.046582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.047172 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.047173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:43.048129 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:43.048132 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.048468 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.048469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:43.048544 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:43.048563 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:23:43.048785 (+ 222us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:23:43.048794 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:23:43.048845 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 06:23:43.048896 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 06:23:43.050055 1272 raft_consensus.cc:1261] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75 [term 1 FOLLOWER]: Refusing update from remote peer b6534242371749649d9400951224a517: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:43.050166 711 raft_consensus.cc:1261] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e [term 1 FOLLOWER]: Refusing update from remote peer b6534242371749649d9400951224a517: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:43.050287 1503 consensus_queue.cc:1035] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:43.050403 1433 consensus_queue.cc:1035] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:43.051007 1431 tablet_replica.cc:439] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75: TxnStatusTablet state changed. Reason: New leader b6534242371749649d9400951224a517. Latest consensus state: current_term: 1 leader_uuid: "b6534242371749649d9400951224a517" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } }
I20260812 06:23:43.051131 1431 tablet_replica.cc:442] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:43.051163 1452 tablet_replica.cc:439] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e: TxnStatusTablet state changed. Reason: New leader b6534242371749649d9400951224a517. Latest consensus state: current_term: 1 leader_uuid: "b6534242371749649d9400951224a517" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } }
I20260812 06:23:43.051285 1452 tablet_replica.cc:442] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:43.051862 1433 tablet_replica.cc:439] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6534242371749649d9400951224a517" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } }
I20260812 06:23:43.051947 1433 tablet_replica.cc:442] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:23:43.052384 1431 tablet_replica.cc:439] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6534242371749649d9400951224a517" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } }
I20260812 06:23:43.052480 1431 tablet_replica.cc:442] T e9835ba3473e4c95b4b950bc98deb399 P 2113ef4a18c5470a96c6a8d3df872c75: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:43.053578 1433 tablet_replica.cc:439] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6534242371749649d9400951224a517" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } }
I20260812 06:23:43.053653 1433 tablet_replica.cc:442] T e9835ba3473e4c95b4b950bc98deb399 P b6534242371749649d9400951224a517: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:23:43.053786 1452 tablet_replica.cc:439] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6534242371749649d9400951224a517" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ce5adba33eb486885f1dd500cac4f4e" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38925 } } peers { permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 } } peers { permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 } } }
I20260812 06:23:43.053864 1452 tablet_replica.cc:442] T e9835ba3473e4c95b4b950bc98deb399 P 6ce5adba33eb486885f1dd500cac4f4e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:43.057751 1415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:43.055548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:39113 (local address 127.30.15.66:39781)
0812 06:23:43.055582 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:43.055584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:43.055718 (+ 134us) server_negotiation.cc:407] Connection header received
0812 06:23:43.055774 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:43.055774 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:43.055783 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:43.055834 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:43.055942 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.056397 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.057130 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.057324 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.057376 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:43.057534 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:43.057573 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:43.057615 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:43.057675 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 06:23:43.057694 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:23:43.057814 1529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:43.055504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:39781 (local address 127.30.15.65:39113)
0812 06:23:43.055651 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:43.055662 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:43.055720 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:43.055838 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:43.055839 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:43.055841 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:23:43.055887 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:43.055888 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.056466 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.056467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:43.057056 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:43.057058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.057383 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.057384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:43.057453 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:43.057468 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:23:43.057622 (+ 154us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:23:43.057624 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:23:43.057672 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:23:43.057724 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":84,"threads_started":1}
I20260812 06:23:43.059923 980 raft_consensus.cc:1261] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517 [term 1 FOLLOWER]: Refusing update from remote peer 6ce5adba33eb486885f1dd500cac4f4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:43.059932 1272 raft_consensus.cc:1261] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75 [term 1 FOLLOWER]: Refusing update from remote peer 6ce5adba33eb486885f1dd500cac4f4e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:43.060125 1435 consensus_queue.cc:1035] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2113ef4a18c5470a96c6a8d3df872c75" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:43.060233 1452 consensus_queue.cc:1035] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6534242371749649d9400951224a517" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:43.067891 1405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:43.065376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:54213 (local address 127.30.15.65:38925)
0812 06:23:43.065415 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:43.065417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:43.065595 (+ 178us) server_negotiation.cc:407] Connection header received
0812 06:23:43.065646 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:43.065647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:43.065656 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:43.065705 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:43.065822 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.066275 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.067153 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.067441 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.067498 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:43.067676 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:43.067713 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:43.067757 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:43.067805 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 06:23:43.067826 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:23:43.067929 1537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:43.065355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:38925 (local address 127.30.15.66:54213)
0812 06:23:43.065518 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:43.065529 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:43.065592 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:43.065709 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:43.065710 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:43.065712 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:23:43.065769 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:43.065771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.066342 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.066343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:43.067084 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:43.067087 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.067531 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.067532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:43.067593 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:43.067608 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:23:43.067762 (+ 154us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:23:43.067764 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:23:43.067804 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 06:23:43.067844 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":94,"threads_started":1}
I20260812 06:23:43.076731 407 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:43.076818 407 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56912:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:43.077346 407 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b06ab40843264d649337f632a2d35606: Sending DeleteTablet for 3 replicas of tablet d8cb43d411fc4b3eb926658eb501dafe
I20260812 06:23:43.077562 662 tablet_service.cc:1514] Processing DeleteTablet for tablet d8cb43d411fc4b3eb926658eb501dafe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:43 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:55274
I20260812 06:23:43.077579 942 tablet_service.cc:1514] Processing DeleteTablet for tablet d8cb43d411fc4b3eb926658eb501dafe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:43 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:44118
I20260812 06:23:43.077584 1231 tablet_service.cc:1514] Processing DeleteTablet for tablet d8cb43d411fc4b3eb926658eb501dafe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:43 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:40234
I20260812 06:23:43.077669 1458 tablet_replica.cc:330] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e: stopping tablet replica
I20260812 06:23:43.077687 1460 tablet_replica.cc:330] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75: stopping tablet replica
I20260812 06:23:43.077735 1458 raft_consensus.cc:2229] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:23:43.077739 1460 raft_consensus.cc:2229] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:43.077775 1460 raft_consensus.cc:2258] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:43.077785 1458 raft_consensus.cc:2258] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:43.077849 1462 tablet_replica.cc:330] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517: stopping tablet replica
I20260812 06:23:43.077895 1462 raft_consensus.cc:2229] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:43.077929 1462 raft_consensus.cc:2258] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:43.078318 1458 ts_tablet_manager.cc:1905] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:43.078612 1462 ts_tablet_manager.cc:1905] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:43.078748 1460 ts_tablet_manager.cc:1905] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:43.079936 1458 ts_tablet_manager.cc:1918] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:23:43.079988 1458 log.cc:1196] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-0/wal/wals/d8cb43d411fc4b3eb926658eb501dafe
I20260812 06:23:43.080207 1458 ts_tablet_manager.cc:1939] T d8cb43d411fc4b3eb926658eb501dafe P 6ce5adba33eb486885f1dd500cac4f4e: Deleting consensus metadata
I20260812 06:23:43.080250 1462 ts_tablet_manager.cc:1918] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:23:43.080291 1462 log.cc:1196] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/d8cb43d411fc4b3eb926658eb501dafe
I20260812 06:23:43.080469 1462 ts_tablet_manager.cc:1939] T d8cb43d411fc4b3eb926658eb501dafe P b6534242371749649d9400951224a517: Deleting consensus metadata
I20260812 06:23:43.080588 386 catalog_manager.cc:4841] TS 6ce5adba33eb486885f1dd500cac4f4e (127.30.15.65:38925): tablet d8cb43d411fc4b3eb926658eb501dafe (table test-table [id=9c7e8fe4ebb142bfaa4d50834805af11]) successfully deleted
I20260812 06:23:43.080606 1460 ts_tablet_manager.cc:1918] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:23:43.080663 1460 log.cc:1196] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/d8cb43d411fc4b3eb926658eb501dafe
I20260812 06:23:43.080756 386 catalog_manager.cc:4841] TS b6534242371749649d9400951224a517 (127.30.15.66:39781): tablet d8cb43d411fc4b3eb926658eb501dafe (table test-table [id=9c7e8fe4ebb142bfaa4d50834805af11]) successfully deleted
I20260812 06:23:43.080858 1460 ts_tablet_manager.cc:1939] T d8cb43d411fc4b3eb926658eb501dafe P 2113ef4a18c5470a96c6a8d3df872c75: Deleting consensus metadata
I20260812 06:23:43.081130 385 catalog_manager.cc:4841] TS 2113ef4a18c5470a96c6a8d3df872c75 (127.30.15.67:38183): tablet d8cb43d411fc4b3eb926658eb501dafe (table test-table [id=9c7e8fe4ebb142bfaa4d50834805af11]) successfully deleted
Aug 12 06:23:43 dist-test-slave-gjrz krb5kdc[331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515822, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.15.65@KRBTEST.COM
I20260812 06:23:43.090031 1405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:43.078599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55290 (local address 127.30.15.65:38925)
0812 06:23:43.080374 (+ 1775us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:43.080376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:43.081528 (+ 1152us) server_negotiation.cc:407] Connection header received
0812 06:23:43.081557 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:43.081558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:43.081572 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:43.081638 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:43.082143 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.082851 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.083624 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.083920 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.083991 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:43.087163 (+ 3172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:43.087174 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:43.087174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:43.087182 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:43.088933 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:43.089262 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:43.089265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:43.089265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:43.089336 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:43.089509 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:43.089510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:43.089510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:43.089683 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:43.089825 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:43.089860 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 06:23:43.089940 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1751}
W20260812 06:23:43.090292 778 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55290
I20260812 06:23:43.097303 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:43.091208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56930 (local address 127.30.15.126:41193)
0812 06:23:43.091250 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:43.091252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:43.091328 (+ 76us) server_negotiation.cc:407] Connection header received
0812 06:23:43.091399 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:43.091400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:43.091411 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:43.091460 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:43.091914 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.092709 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.093349 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:43.093662 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:43.093727 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:43.094750 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:43.094752 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:43.094752 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:43.094759 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:43.096289 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:43.096602 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:43.096603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:43.096603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:43.096669 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:43.096817 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:43.096818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:43.096818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:43.096938 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:43.097030 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:43.097125 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 06:23:43.097209 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 06:23:43.099476 407 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56930
I20260812 06:23:43.100116 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 533
I20260812 06:23:43.118961 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 815
I20260812 06:23:43.132234 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 1103
I20260812 06:23:43.141430 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 350
2026-08-12T06:23:43Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2477 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:23:43 dist-test-slave-gjrz krb5kdc[1551](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:23:43 dist-test-slave-gjrz krb5kdc[1551](info): set up 2 sockets
Aug 12 06:23:43 dist-test-slave-gjrz krb5kdc[1551](info): commencing operation
krb5kdc: starting...
W20260812 06:23:44.341831 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:23:44 dist-test-slave-gjrz krb5kdc[1551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:23:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:23:44.449810 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:36123
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:37085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:36123
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:44.527989 1579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:44.528177 1579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:44.528198 1579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:44.529289 1579 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:44.529327 1579 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:23:44.529340 1579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:44.529351 1579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:44.529374 1579 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:44.529390 1579 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:23:44.530807 1579 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:37085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:36123
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:36123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:44.531014 1579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:44.531220 1579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:44.535641 1597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:44.535655 1585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:44.535655 1586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:44.535845 1579 server_base.cc:1034] running on GCE node
I20260812 06:23:44.536154 1579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:44.536406 1579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:44.537539 1579 hybrid_clock.cc:648] HybridClock initialized: now 1786515824537527 us; error 30 us; skew 500 ppm
Aug 12 06:23:44 dist-test-slave-gjrz krb5kdc[1551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515824, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:44.539790 1579 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:23:44.540154 1579 webserver.cc:460] Webserver started at http://127.30.15.126:36017/ using document root <none> and password file <none>
I20260812 06:23:44.540314 1579 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:44.540351 1579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:44.540436 1579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:44.541338 1579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "d54e7e38c2594ed08266d35913783ad9"
format_stamp: "Formatted at 2026-08-12 06:23:44 on dist-test-slave-gjrz"
server_key: "fa8dc521f2907d5f44532af9e8474715"
server_key_iv: "b0b92b7af9e945f5b89f048985a7b21f"
server_key_version: "encryptionkey@0"
I20260812 06:23:44.541611 1579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "d54e7e38c2594ed08266d35913783ad9"
format_stamp: "Formatted at 2026-08-12 06:23:44 on dist-test-slave-gjrz"
server_key: "fa8dc521f2907d5f44532af9e8474715"
server_key_iv: "b0b92b7af9e945f5b89f048985a7b21f"
server_key_version: "encryptionkey@0"
I20260812 06:23:44.542742 1579 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:23:44.543370 1614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:44.543522 1579 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:44.543601 1579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "d54e7e38c2594ed08266d35913783ad9"
format_stamp: "Formatted at 2026-08-12 06:23:44 on dist-test-slave-gjrz"
server_key: "fa8dc521f2907d5f44532af9e8474715"
server_key_iv: "b0b92b7af9e945f5b89f048985a7b21f"
server_key_version: "encryptionkey@0"
I20260812 06:23:44.543663 1579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:44.562141 1579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:44.563727 1579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:44.563851 1579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:44.568156 1579 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:36123
I20260812 06:23:44.568251 1755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:36123 every 8 connection(s)
I20260812 06:23:44.568477 1579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:44.569097 1756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:44.571208 1756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9: Bootstrap starting.
I20260812 06:23:44.571815 1756 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:44.572079 1756 log.cc:824] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:44.572726 1756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9: No bootstrap required, opened a new log
I20260812 06:23:44.573734 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 1579
I20260812 06:23:44.573815 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:44.573956 30781 external_mini_cluster.cc:1428] Setting key d0a7ef0bd8ba57756e7900d3c26d6d3f
I20260812 06:23:44.575088 1756 raft_consensus.cc:348] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d54e7e38c2594ed08266d35913783ad9" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 36123 } }
I20260812 06:23:44.575246 1756 raft_consensus.cc:374] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:44.575354 1756 raft_consensus.cc:729] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54e7e38c2594ed08266d35913783ad9, State: Initialized, Role: FOLLOWER
I20260812 06:23:44.575505 1756 consensus_queue.cc:260] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d54e7e38c2594ed08266d35913783ad9" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 36123 } }
I20260812 06:23:44.575582 1756 raft_consensus.cc:388] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:44.575615 1756 raft_consensus.cc:482] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:44.575662 1756 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:44.576275 1756 raft_consensus.cc:504] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d54e7e38c2594ed08266d35913783ad9" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 36123 } }
I20260812 06:23:44.576386 1756 leader_election.cc:302] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d54e7e38c2594ed08266d35913783ad9; no voters:
I20260812 06:23:44.576550 1756 leader_election.cc:288] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:44.576581 1771 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:44.576740 1771 raft_consensus.cc:686] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [term 1 LEADER]: Becoming Leader. State: Replica: d54e7e38c2594ed08266d35913783ad9, State: Running, Role: LEADER
I20260812 06:23:44.576773 1756 sys_catalog.cc:564] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:44.576890 1771 consensus_queue.cc:237] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d54e7e38c2594ed08266d35913783ad9" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 36123 } }
I20260812 06:23:44.577440 1774 sys_catalog.cc:455] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d54e7e38c2594ed08266d35913783ad9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d54e7e38c2594ed08266d35913783ad9" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 36123 } } }
I20260812 06:23:44.577692 1774 sys_catalog.cc:458] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:44.577625 1772 sys_catalog.cc:455] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d54e7e38c2594ed08266d35913783ad9. Latest consensus state: current_term: 1 leader_uuid: "d54e7e38c2594ed08266d35913783ad9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d54e7e38c2594ed08266d35913783ad9" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 36123 } } }
I20260812 06:23:44.577955 1772 sys_catalog.cc:458] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:44.578096 1787 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:44.578614 1787 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:44.580296 1787 catalog_manager.cc:1347] Generated new cluster ID: 9454cc9740154ed3b4bc3dd82a4d4d03
I20260812 06:23:44.580390 1787 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:23:44 dist-test-slave-gjrz krb5kdc[1551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:44.584167 1764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:44.574435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52588 (local address 127.30.15.126:36123)
0812 06:23:44.574648 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:44.574658 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:44.574696 (+ 38us) server_negotiation.cc:407] Connection header received
0812 06:23:44.575061 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:44.575070 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:44.575131 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:44.575305 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:44.575928 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.577241 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.578243 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.578769 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.578872 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:44.581215 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:44.581219 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:44.581220 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:44.581231 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:44.582740 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:44.583067 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:44.583070 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:44.583071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:44.583176 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:44.583393 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:44.583394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:44.583395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:44.583616 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:44.583772 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:44.583878 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 06:23:44.584013 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
I20260812 06:23:44.626420 1787 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:44.627141 1787 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:44.629359 1787 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9: Generated new TSK 0
I20260812 06:23:44.629523 1787 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:23:44.660235 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:36123
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:37085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:44.739919 1804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:44.740100 1804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:44.740123 1804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:44.741253 1804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:44.741294 1804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:44.741317 1804 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:23:44.741341 1804 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:23:44.741369 1804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:23:44.742797 1804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:37085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.15.126:36123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:44.743003 1804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:44.743201 1804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:44.747866 1819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:44.747872 1810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:44.747877 1815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:44.748001 1804 server_base.cc:1034] running on GCE node
I20260812 06:23:44.748301 1804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:44.748534 1804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:44.749670 1804 hybrid_clock.cc:648] HybridClock initialized: now 1786515824749655 us; error 29 us; skew 500 ppm
Aug 12 06:23:44 dist-test-slave-gjrz krb5kdc[1551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515824, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:44.752110 1804 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:23:44.752601 1804 webserver.cc:460] Webserver started at http://127.30.15.65:39907/ using document root <none> and password file <none>
I20260812 06:23:44.752841 1804 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:44.752936 1804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:44.753072 1804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:44.754012 1804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "e2aa67117cf2421cac941b25f3f457da"
format_stamp: "Formatted at 2026-08-12 06:23:44 on dist-test-slave-gjrz"
server_key: "9246ebd7e5260cd8acc16b3b6aa0a945"
server_key_iv: "6bd0e2e97a4ddc02a9d5a61a840e1d7b"
server_key_version: "encryptionkey@0"
I20260812 06:23:44.754364 1804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "e2aa67117cf2421cac941b25f3f457da"
format_stamp: "Formatted at 2026-08-12 06:23:44 on dist-test-slave-gjrz"
server_key: "9246ebd7e5260cd8acc16b3b6aa0a945"
server_key_iv: "6bd0e2e97a4ddc02a9d5a61a840e1d7b"
server_key_version: "encryptionkey@0"
I20260812 06:23:44.755625 1804 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:23:44.756333 1832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:44.756493 1804 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:44.756573 1804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "e2aa67117cf2421cac941b25f3f457da"
format_stamp: "Formatted at 2026-08-12 06:23:44 on dist-test-slave-gjrz"
server_key: "9246ebd7e5260cd8acc16b3b6aa0a945"
server_key_iv: "6bd0e2e97a4ddc02a9d5a61a840e1d7b"
server_key_version: "encryptionkey@0"
I20260812 06:23:44.756639 1804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:44.767889 1804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:44.769465 1804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:44.769588 1804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:44.770046 1804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:44.770087 1804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:44.770112 1804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:44.770135 1804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:44.776439 1804 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:42869
Aug 12 06:23:44 dist-test-slave-gjrz krb5kdc[1551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515824, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:44.776530 2052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:42869 every 8 connection(s)
I20260812 06:23:44.776877 1804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:23:44.779454 1764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:44.770436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:49709 (local address 127.30.15.126:36123)
0812 06:23:44.770498 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:44.770501 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:44.770678 (+ 177us) server_negotiation.cc:407] Connection header received
0812 06:23:44.771142 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:44.771143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:44.771159 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:44.771209 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:44.771966 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.772720 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.774204 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.774556 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.774638 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:44.777025 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:44.777027 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:44.777027 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:44.777034 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:44.778384 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:44.778730 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:44.778731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:44.778731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:44.778784 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:44.778940 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:44.778940 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:44.778940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:44.779037 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:44.779084 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:44.779307 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 06:23:44.779390 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:23:44.779614 1849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:44.770410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:36123 (local address 127.30.15.65:49709)
0812 06:23:44.770574 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:44.770611 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:44.771049 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:44.771306 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:44.771311 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:44.771597 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:44.771857 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:44.771863 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.772843 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.772844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:44.774109 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:44.774113 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.774653 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.774654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:44.774791 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:44.775253 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:44.775279 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:44.776908 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:44.778462 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:44.778469 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:44.778470 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:44.778672 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:44.778822 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:44.778822 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:44.778823 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:44.778901 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:44.779083 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:44.779086 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:44.779193 (+ 107us) client_negotiation.cc:769] Sending connection context
0812 06:23:44.779292 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 06:23:44.779431 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
I20260812 06:23:44.780082 2057 heartbeater.cc:347] Connected to a master server at 127.30.15.126:36123
I20260812 06:23:44.780164 2057 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:44.780326 2057 heartbeater.cc:511] Master 127.30.15.126:36123 requested a full tablet report, sending...
I20260812 06:23:44.780761 1649 ts_manager.cc:194] Registered new tserver with Master: e2aa67117cf2421cac941b25f3f457da (127.30.15.65:42869)
I20260812 06:23:44.781435 1649 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:49709
I20260812 06:23:44.784559 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 1804
I20260812 06:23:44.784636 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:23:44.784797 30781 external_mini_cluster.cc:1428] Setting key b86cc1fdcf0c26f286eb4111408a836f
I20260812 06:23:44.785966 1764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:44.781063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:60051 (local address 127.30.15.126:36123)
0812 06:23:44.781116 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:44.781118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:44.781173 (+ 55us) server_negotiation.cc:407] Connection header received
0812 06:23:44.781239 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:44.781239 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:44.781248 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:44.781288 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:44.781669 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.782202 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.782847 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.783044 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.783096 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:44.783825 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:44.783826 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:44.783826 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:44.783832 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:44.785040 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:44.785332 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:44.785333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:44.785333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:44.785393 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:44.785586 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:44.785587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:44.785587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:44.785674 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:44.785717 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:44.785859 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 06:23:44.785913 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:23:44.786026 2068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:44.780997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:36123 (local address 127.30.15.65:60051)
0812 06:23:44.781120 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:44.781130 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:44.781186 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:44.781291 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:44.781292 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:44.781461 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:44.781529 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:44.781531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.782297 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.782298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:44.782775 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:44.782776 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.783099 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.783100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:44.783153 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:44.783480 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:44.783484 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:44.783760 (+ 276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:44.785105 (+ 1345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:44.785106 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:44.785107 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:44.785269 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:44.785454 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:44.785455 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:44.785455 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:44.785528 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:44.785722 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:44.785723 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:44.785777 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 06:23:44.785844 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:23:44.785935 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":68,"threads_started":1}
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:23:44.807865 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:36123
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:37085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:44.887195 2072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:44.887416 2072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:44.887442 2072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:44.888563 2072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:44.888600 2072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:44.888619 2072 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:23:44.888629 2072 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:23:44.888648 2072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:23:44.889992 2072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:37085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.15.126:36123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:44.890154 2072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:44.890311 2072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:44.895004 2082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:44.894999 2083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:44.895012 2072 server_base.cc:1034] running on GCE node
W20260812 06:23:44.894997 2086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:44.895481 2072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:44.895681 2072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:44.896821 2072 hybrid_clock.cc:648] HybridClock initialized: now 1786515824896805 us; error 29 us; skew 500 ppm
Aug 12 06:23:44 dist-test-slave-gjrz krb5kdc[1551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515824, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:44.899111 2072 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:23:44.899504 2072 webserver.cc:460] Webserver started at http://127.30.15.66:37733/ using document root <none> and password file <none>
I20260812 06:23:44.899669 2072 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:44.899705 2072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:44.899788 2072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:44.900677 2072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "daead66e493d40878b85844bb413e1df"
format_stamp: "Formatted at 2026-08-12 06:23:44 on dist-test-slave-gjrz"
server_key: "ee6b12689a75d140dda051750422ac94"
server_key_iv: "a140229a0fa175a4d4610d6f629eee0e"
server_key_version: "encryptionkey@0"
I20260812 06:23:44.900947 2072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "daead66e493d40878b85844bb413e1df"
format_stamp: "Formatted at 2026-08-12 06:23:44 on dist-test-slave-gjrz"
server_key: "ee6b12689a75d140dda051750422ac94"
server_key_iv: "a140229a0fa175a4d4610d6f629eee0e"
server_key_version: "encryptionkey@0"
I20260812 06:23:44.902053 2072 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:23:44.902676 2107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:44.902828 2072 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:44.902905 2072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "daead66e493d40878b85844bb413e1df"
format_stamp: "Formatted at 2026-08-12 06:23:44 on dist-test-slave-gjrz"
server_key: "ee6b12689a75d140dda051750422ac94"
server_key_iv: "a140229a0fa175a4d4610d6f629eee0e"
server_key_version: "encryptionkey@0"
I20260812 06:23:44.902956 2072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:44.925643 2072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:44.927203 2072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:44.927354 2072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:44.927802 2072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:44.927840 2072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:44.927860 2072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:44.927870 2072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:44.934150 2072 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:38201
Aug 12 06:23:44 dist-test-slave-gjrz krb5kdc[1551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515824, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:44.934180 2330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:38201 every 8 connection(s)
I20260812 06:23:44.934515 2072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:23:44.937129 1764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:44.928213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:38369 (local address 127.30.15.126:36123)
0812 06:23:44.928277 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:44.928280 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:44.928435 (+ 155us) server_negotiation.cc:407] Connection header received
0812 06:23:44.928844 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:44.928846 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:44.928858 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:44.928930 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:44.929654 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.930384 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.931860 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.932148 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.932230 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:44.934697 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:44.934699 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:44.934699 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:44.934707 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:44.936055 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:44.936415 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:44.936415 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:44.936416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:44.936468 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:44.936659 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:44.936659 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:44.936659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:44.936755 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:44.936802 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:44.937001 (+ 199us) server_negotiation.cc:299] Negotiation successful
0812 06:23:44.937056 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:23:44.937258 2129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:44.928145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:36123 (local address 127.30.15.66:38369)
0812 06:23:44.928315 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:44.928352 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:44.928762 (+ 410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:44.928978 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:44.928981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:44.929287 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:44.929549 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:44.929556 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.930484 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.930485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:44.931763 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:44.931767 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.932252 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.932253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:44.932391 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:44.932900 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:44.932908 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:44.934606 (+ 1698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:44.936147 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:44.936154 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:44.936156 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:44.936354 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:44.936516 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:44.936517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:44.936517 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:44.936614 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:44.936809 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:44.936813 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:44.936914 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 06:23:44.936987 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 06:23:44.937098 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
I20260812 06:23:44.937729 2331 heartbeater.cc:347] Connected to a master server at 127.30.15.126:36123
I20260812 06:23:44.937814 2331 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:44.937985 2331 heartbeater.cc:511] Master 127.30.15.126:36123 requested a full tablet report, sending...
I20260812 06:23:44.938335 1648 ts_manager.cc:194] Registered new tserver with Master: daead66e493d40878b85844bb413e1df (127.30.15.66:38201)
I20260812 06:23:44.938704 1648 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:38369
I20260812 06:23:44.942117 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 2072
I20260812 06:23:44.942214 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:23:44.942395 30781 external_mini_cluster.cc:1428] Setting key c4413842b05ffb6af78a7b5f2e0886be
I20260812 06:23:44.943596 2344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:44.938679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:36123 (local address 127.30.15.66:46319)
0812 06:23:44.938848 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:44.938858 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:44.938917 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:44.939027 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:44.939028 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:44.939175 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:44.939229 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:44.939230 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.939893 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.939893 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:44.940369 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:44.940370 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.940635 (+ 265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.940635 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:44.940683 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:44.941031 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:44.941035 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:44.941313 (+ 278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:44.942628 (+ 1315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:44.942629 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:44.942630 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:44.942822 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:44.942977 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:44.942978 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:44.942978 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:44.943030 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:44.943340 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:44.943341 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:44.943401 (+ 60us) client_negotiation.cc:769] Sending connection context
0812 06:23:44.943453 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 06:23:44.943526 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":68,"threads_started":1}
I20260812 06:23:44.943629 1764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:44.938753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:46319 (local address 127.30.15.126:36123)
0812 06:23:44.938792 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:44.938794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:44.938917 (+ 123us) server_negotiation.cc:407] Connection header received
0812 06:23:44.938969 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:44.938970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:44.938977 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:44.939026 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:44.939306 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.939800 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.940421 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:44.940589 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:44.940630 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:44.941373 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:44.941373 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:44.941374 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:44.941378 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:44.942543 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:44.942878 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:44.942879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:44.942879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:44.942926 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:44.943076 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:44.943077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:44.943077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:44.943284 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:44.943347 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:44.943491 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 06:23:44.943555 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:23:44.966341 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:36123
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:37085
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:45.045843 2349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:45.046018 2349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:45.046041 2349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:45.047128 2349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:45.047169 2349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:45.047188 2349 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:23:45.047200 2349 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:23:45.047219 2349 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:23:45.048664 2349 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:37085
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.15.126:36123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:45.048835 2349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:45.049002 2349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:45.053740 2357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:45.053778 2362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:45.053730 2358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:45.053769 2349 server_base.cc:1034] running on GCE node
I20260812 06:23:45.054134 2349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:45.054344 2349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:45.055472 2349 hybrid_clock.cc:648] HybridClock initialized: now 1786515825055458 us; error 32 us; skew 500 ppm
Aug 12 06:23:45 dist-test-slave-gjrz krb5kdc[1551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515825, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:45.057696 2349 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:23:45.058070 2349 webserver.cc:460] Webserver started at http://127.30.15.67:43061/ using document root <none> and password file <none>
I20260812 06:23:45.058260 2349 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:45.058306 2349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:45.058422 2349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:45.059401 2349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "a23714d8ae3b4097b66be67f6ba0e0f6"
format_stamp: "Formatted at 2026-08-12 06:23:45 on dist-test-slave-gjrz"
server_key: "5ec0e1c23c16104a0133be0d269394e9"
server_key_iv: "feac83f7bf6226b434f712d21db6bffd"
server_key_version: "encryptionkey@0"
I20260812 06:23:45.059722 2349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "a23714d8ae3b4097b66be67f6ba0e0f6"
format_stamp: "Formatted at 2026-08-12 06:23:45 on dist-test-slave-gjrz"
server_key: "5ec0e1c23c16104a0133be0d269394e9"
server_key_iv: "feac83f7bf6226b434f712d21db6bffd"
server_key_version: "encryptionkey@0"
I20260812 06:23:45.060914 2349 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:45.061525 2382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:45.061679 2349 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:45.061757 2349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "a23714d8ae3b4097b66be67f6ba0e0f6"
format_stamp: "Formatted at 2026-08-12 06:23:45 on dist-test-slave-gjrz"
server_key: "5ec0e1c23c16104a0133be0d269394e9"
server_key_iv: "feac83f7bf6226b434f712d21db6bffd"
server_key_version: "encryptionkey@0"
I20260812 06:23:45.061815 2349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:45.099916 2349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:45.102106 2349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:45.102239 2349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:45.102727 2349 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:45.102767 2349 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:45.102797 2349 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:45.102813 2349 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:23:45 dist-test-slave-gjrz krb5kdc[1551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515825, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:45.111052 2349 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:43563
I20260812 06:23:45.111132 2605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:43563 every 8 connection(s)
I20260812 06:23:45.111471 2349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:23:45.111832 1764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.103151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:50019 (local address 127.30.15.126:36123)
0812 06:23:45.103192 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.103194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.103452 (+ 258us) server_negotiation.cc:407] Connection header received
0812 06:23:45.103912 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.103914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.103928 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.104004 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:45.104613 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.105132 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.106283 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.106605 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.106663 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.108779 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:45.108781 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:45.108781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:45.108789 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:45.110400 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:45.110802 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:45.110804 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:45.110804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:45.110870 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:45.111108 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:45.111109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:45.111110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:45.111246 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:45.111330 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.111653 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.111746 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:23:45.112025 2395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.103153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:36123 (local address 127.30.15.67:50019)
0812 06:23:45.103329 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.103366 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.103820 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.104082 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.104085 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.104307 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:45.104490 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.104495 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.105220 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.105221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.106199 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.106202 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.106693 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.106694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.106825 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.107307 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:45.107317 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:45.108695 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:45.110488 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:45.110495 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:45.110497 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:45.110730 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:45.110920 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:45.110920 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:45.110921 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:45.111030 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:45.111344 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:45.111350 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:45.111500 (+ 150us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.111630 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.111801 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":85,"threads_started":1}
I20260812 06:23:45.112457 2606 heartbeater.cc:347] Connected to a master server at 127.30.15.126:36123
I20260812 06:23:45.112538 2606 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:45.112694 2606 heartbeater.cc:511] Master 127.30.15.126:36123 requested a full tablet report, sending...
I20260812 06:23:45.113036 1649 ts_manager.cc:194] Registered new tserver with Master: a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563)
I20260812 06:23:45.113458 1649 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:50019
I20260812 06:23:45.117905 1764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.113506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:41483 (local address 127.30.15.126:36123)
0812 06:23:45.113546 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.113548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.113645 (+ 97us) server_negotiation.cc:407] Connection header received
0812 06:23:45.113688 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.113689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.113699 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.113764 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:45.114107 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.114547 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.115155 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.115384 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.115426 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.116196 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:45.116197 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:45.116197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:45.116201 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:45.117168 (+ 967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:45.117432 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:45.117432 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:45.117432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:45.117473 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:45.117584 (+ 111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:45.117584 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:45.117584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:45.117663 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:45.117704 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.117804 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.117853 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:23:45.117923 2616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.113435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:36123 (local address 127.30.15.67:41483)
0812 06:23:45.113583 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.113593 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.113645 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.113768 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.113768 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.113961 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:45.114026 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.114028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.114626 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.114627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.115099 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.115101 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.115439 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.115440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.115497 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.115866 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:45.115870 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:45.116136 (+ 266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:45.117229 (+ 1093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:45.117230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:45.117231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:45.117381 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:45.117511 (+ 130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:45.117512 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:45.117512 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:45.117552 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:45.117703 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:45.117703 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:45.117747 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.117790 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.117860 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260812 06:23:45.120805 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 2349
I20260812 06:23:45.120877 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:23:45.121018 30781 external_mini_cluster.cc:1428] Setting key 74eacbe8163c3a602b1994270cb9bec3
I20260812 06:23:45.121701 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:23:45 dist-test-slave-gjrz krb5kdc[1551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:23:45 dist-test-slave-gjrz krb5kdc[1551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:45.143844 1764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.137704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52598 (local address 127.30.15.126:36123)
0812 06:23:45.137743 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.137744 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.137788 (+ 44us) server_negotiation.cc:407] Connection header received
0812 06:23:45.137835 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.137836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.137844 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.137888 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:45.138375 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.138840 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.139571 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.139742 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.139785 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.141717 (+ 1932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:45.141718 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:45.141718 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:45.141724 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:45.142948 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:45.143306 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:45.143307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:45.143307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:45.143355 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:45.143502 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:45.143503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:45.143503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:45.143595 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:45.143660 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.143732 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.143786 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:23:45.145364 1649 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52598:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:23:45.146983 1649 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:23:45.153205 2637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.149082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:38201 (local address 127.0.0.1:54574)
0812 06:23:45.149545 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.149586 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.149663 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.150108 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.150109 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.150111 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:45.150153 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.150154 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.151461 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.151462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.152325 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.152327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.152950 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.152951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.153025 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.153029 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.153083 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.153140 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":62,"threads_started":1}
I20260812 06:23:45.153261 2644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.149383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54574 (local address 127.30.15.66:38201)
0812 06:23:45.149553 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.149558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.149643 (+ 85us) server_negotiation.cc:407] Connection header received
0812 06:23:45.149744 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.149746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.149760 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.149828 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:45.150217 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.151380 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.152398 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.152871 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.152933 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.152988 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.153133 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.153175 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":77,"threads_started":1}
I20260812 06:23:45.153270 2639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.149197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58884 (local address 127.30.15.67:43563)
0812 06:23:45.149354 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.149358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.149653 (+ 295us) server_negotiation.cc:407] Connection header received
0812 06:23:45.149743 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.149746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.149761 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.149833 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:45.150074 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.150803 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.152047 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.152776 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.152815 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.152871 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.153136 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.153177 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260812 06:23:45.153482 2640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.149087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:43563 (local address 127.0.0.1:58884)
0812 06:23:45.149584 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.149594 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.149663 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.149902 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.149904 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.149907 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:45.149978 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.149979 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.150876 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.150877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.151947 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.151950 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.152928 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.152929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.153010 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.153022 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.153375 (+ 353us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.153420 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":70,"threads_started":1}
I20260812 06:23:45.153745 2638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.149282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:42869 (local address 127.0.0.1:47546)
0812 06:23:45.149765 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.149773 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.149820 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.150134 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.150135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.150137 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:45.150176 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.150177 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.151458 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.151459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.152631 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.152635 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.153526 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.153527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.153589 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.153593 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.153646 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.153683 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"mutex_wait_us":30,"thread_start_us":82,"threads_started":1}
I20260812 06:23:45.153811 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.149416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47546 (local address 127.30.15.65:42869)
0812 06:23:45.149593 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.149597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.149885 (+ 288us) server_negotiation.cc:407] Connection header received
0812 06:23:45.149935 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.149937 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.149952 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.150025 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:45.150251 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.151361 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.152726 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.153442 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.153514 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.153580 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.153671 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.153710 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":80,"threads_started":1}
I20260812 06:23:45.154204 2479 tablet_service.cc:1467] Processing CreateTablet for tablet df9da14c92784d3ea221fd42ffeac027 (DEFAULT_TABLE table=test-table [id=2da7d5d59e694d6da7d453ec8c89ee18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:45.154199 2205 tablet_service.cc:1467] Processing CreateTablet for tablet df9da14c92784d3ea221fd42ffeac027 (DEFAULT_TABLE table=test-table [id=2da7d5d59e694d6da7d453ec8c89ee18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:45.154542 2479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df9da14c92784d3ea221fd42ffeac027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:45.154559 2205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df9da14c92784d3ea221fd42ffeac027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:45.157075 2647 tablet_bootstrap.cc:492] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6: Bootstrap starting.
I20260812 06:23:45.157478 2649 tablet_bootstrap.cc:492] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df: Bootstrap starting.
I20260812 06:23:45.157868 1941 tablet_service.cc:1467] Processing CreateTablet for tablet df9da14c92784d3ea221fd42ffeac027 (DEFAULT_TABLE table=test-table [id=2da7d5d59e694d6da7d453ec8c89ee18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:45.158015 2649 tablet_bootstrap.cc:654] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:45.158079 2647 tablet_bootstrap.cc:654] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:45.158205 1941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df9da14c92784d3ea221fd42ffeac027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:45.158299 2649 log.cc:824] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:45.158456 2647 log.cc:824] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:45.159075 2649 tablet_bootstrap.cc:492] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df: No bootstrap required, opened a new log
I20260812 06:23:45.159134 2649 ts_tablet_manager.cc:1397] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:23:45.159578 2647 tablet_bootstrap.cc:492] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6: No bootstrap required, opened a new log
I20260812 06:23:45.159636 2647 ts_tablet_manager.cc:1397] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:23:45.161059 2649 raft_consensus.cc:348] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.161213 2649 raft_consensus.cc:374] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:45.161247 2649 raft_consensus.cc:729] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daead66e493d40878b85844bb413e1df, State: Initialized, Role: FOLLOWER
I20260812 06:23:45.161182 2647 raft_consensus.cc:348] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.161291 2647 raft_consensus.cc:374] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:45.161311 2647 raft_consensus.cc:729] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23714d8ae3b4097b66be67f6ba0e0f6, State: Initialized, Role: FOLLOWER
I20260812 06:23:45.161360 2649 consensus_queue.cc:260] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.161433 2647 consensus_queue.cc:260] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.161633 2649 ts_tablet_manager.cc:1428] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:23:45.161659 2647 ts_tablet_manager.cc:1428] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:23:45.161671 2331 heartbeater.cc:503] Master 127.30.15.126:36123 was elected leader, sending a full tablet report...
I20260812 06:23:45.161767 2606 heartbeater.cc:503] Master 127.30.15.126:36123 was elected leader, sending a full tablet report...
I20260812 06:23:45.162251 2658 tablet_bootstrap.cc:492] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da: Bootstrap starting.
I20260812 06:23:45.162887 2658 tablet_bootstrap.cc:654] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:45.163160 2658 log.cc:824] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:45.163848 2658 tablet_bootstrap.cc:492] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da: No bootstrap required, opened a new log
I20260812 06:23:45.163900 2658 ts_tablet_manager.cc:1397] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:23:45.165292 2658 raft_consensus.cc:348] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.165424 2658 raft_consensus.cc:374] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:45.165448 2658 raft_consensus.cc:729] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2aa67117cf2421cac941b25f3f457da, State: Initialized, Role: FOLLOWER
I20260812 06:23:45.165552 2658 consensus_queue.cc:260] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.165759 2658 ts_tablet_manager.cc:1428] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:23:45.165819 2057 heartbeater.cc:503] Master 127.30.15.126:36123 was elected leader, sending a full tablet report...
W20260812 06:23:45.185278 2335 tablet.cc:2369] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:23:45.217839 2664 raft_consensus.cc:482] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:23:45.217950 2664 raft_consensus.cc:504] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.218269 2664 leader_election.cc:288] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers daead66e493d40878b85844bb413e1df (127.30.15.66:38201), a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563)
I20260812 06:23:45.221019 2644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.218549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:44929 (local address 127.30.15.66:38201)
0812 06:23:45.218594 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.218596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.218603 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:23:45.218629 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.218630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.218639 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.218694 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:45.218857 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.219414 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.220328 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.220676 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.220728 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.220737 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.220913 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.220956 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:23:45.221019 1849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.218426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:38201 (local address 127.30.15.65:44929)
0812 06:23:45.218466 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.218477 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.218517 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.218712 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.218713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.218716 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:45.218790 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.218793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.219488 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.219489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.220244 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.220246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.220769 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.220770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.220850 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.220854 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.220904 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.220944 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21,"mutex_wait_us":4}
I20260812 06:23:45.221107 2639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.218504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:44967 (local address 127.30.15.67:43563)
0812 06:23:45.218560 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.218562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.218695 (+ 133us) server_negotiation.cc:407] Connection header received
0812 06:23:45.218738 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.218739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.218747 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.218806 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:45.218974 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.219468 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.220345 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.220726 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.220788 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.220796 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.220985 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.221042 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:23:45.221350 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.218428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:43563 (local address 127.30.15.65:44967)
0812 06:23:45.218633 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.218643 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.218693 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.218812 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.218813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.218824 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:45.218915 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.218916 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.219544 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.219545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.220256 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.220258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.220811 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.220812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.220896 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.220900 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.221218 (+ 318us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.221265 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":45,"thread_start_us":104,"threads_started":1}
I20260812 06:23:45.221330 2239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df9da14c92784d3ea221fd42ffeac027" candidate_uuid: "e2aa67117cf2421cac941b25f3f457da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daead66e493d40878b85844bb413e1df" is_pre_election: true
I20260812 06:23:45.221462 2239 raft_consensus.cc:2454] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2aa67117cf2421cac941b25f3f457da in term 0.
I20260812 06:23:45.221673 1834 leader_election.cc:302] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daead66e493d40878b85844bb413e1df, e2aa67117cf2421cac941b25f3f457da; no voters:
I20260812 06:23:45.221685 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df9da14c92784d3ea221fd42ffeac027" candidate_uuid: "e2aa67117cf2421cac941b25f3f457da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" is_pre_election: true
I20260812 06:23:45.221802 2516 raft_consensus.cc:2454] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2aa67117cf2421cac941b25f3f457da in term 0.
I20260812 06:23:45.221801 2664 raft_consensus.cc:2781] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:23:45.221855 2664 raft_consensus.cc:482] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:23:45.221899 2664 raft_consensus.cc:3037] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:45.222590 2664 raft_consensus.cc:504] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.222704 2664 leader_election.cc:288] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [CANDIDATE]: Term 1 election: Requested vote from peers daead66e493d40878b85844bb413e1df (127.30.15.66:38201), a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563)
I20260812 06:23:45.222842 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df9da14c92784d3ea221fd42ffeac027" candidate_uuid: "e2aa67117cf2421cac941b25f3f457da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6"
I20260812 06:23:45.222880 2239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df9da14c92784d3ea221fd42ffeac027" candidate_uuid: "e2aa67117cf2421cac941b25f3f457da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daead66e493d40878b85844bb413e1df"
I20260812 06:23:45.222918 2516 raft_consensus.cc:3037] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:45.222965 2239 raft_consensus.cc:3037] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:45.223634 2516 raft_consensus.cc:2454] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2aa67117cf2421cac941b25f3f457da in term 1.
I20260812 06:23:45.223718 2239 raft_consensus.cc:2454] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2aa67117cf2421cac941b25f3f457da in term 1.
I20260812 06:23:45.224076 1836 leader_election.cc:302] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a23714d8ae3b4097b66be67f6ba0e0f6, e2aa67117cf2421cac941b25f3f457da; no voters:
I20260812 06:23:45.224187 2664 raft_consensus.cc:2781] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:45.224315 2664 raft_consensus.cc:686] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 1 LEADER]: Becoming Leader. State: Replica: e2aa67117cf2421cac941b25f3f457da, State: Running, Role: LEADER
I20260812 06:23:45.224387 2664 consensus_queue.cc:237] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.225111 1648 catalog_manager.cc:5495] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da reported cstate change: term changed from 0 to 1, leader changed from <none> to e2aa67117cf2421cac941b25f3f457da (127.30.15.65). New cstate: current_term: 1 leader_uuid: "e2aa67117cf2421cac941b25f3f457da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } health_report { overall_health: UNKNOWN } } }
Aug 12 06:23:45 dist-test-slave-gjrz krb5kdc[1551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515824, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:45.266134 2685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.259866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:36123 (local address 127.0.0.1:52608)
0812 06:23:45.260034 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.260043 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.260104 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.260218 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.260219 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.260508 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:45.260554 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.260557 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.261169 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.261170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.261679 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.261680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.261993 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.261994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.262052 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.262571 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:45.262575 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:45.263913 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:45.265195 (+ 1282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:45.265202 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:45.265204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:45.265405 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:45.265592 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:45.265593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:45.265593 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:45.265648 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:45.265858 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:45.265862 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:45.265903 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.265948 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.266061 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
I20260812 06:23:45.266194 1764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.259905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52608 (local address 127.30.15.126:36123)
0812 06:23:45.259961 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.259963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.260100 (+ 137us) server_negotiation.cc:407] Connection header received
0812 06:23:45.260151 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.260151 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.260161 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.260208 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:45.260631 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.261104 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.261747 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.261936 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.261989 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.263990 (+ 2001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:45.263992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:45.263992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:45.263999 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:45.265125 (+ 1126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:45.265470 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:45.265471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:45.265471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:45.265523 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:45.265691 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:45.265692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:45.265692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:45.265813 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:45.265863 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.265971 (+ 108us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.266114 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":79,"server-negotiator.queue_time_us":32}
I20260812 06:23:45.268040 1648 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:52608:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 06:23:45.268215 1648 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:23:45.269487 1941 tablet_service.cc:1467] Processing CreateTablet for tablet f602f24ba4f4464492b216cb6504ac85 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6c0ec6b40df5487f91555e90f8bfeadb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:23:45.269557 2205 tablet_service.cc:1467] Processing CreateTablet for tablet f602f24ba4f4464492b216cb6504ac85 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6c0ec6b40df5487f91555e90f8bfeadb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:23:45.269541 2479 tablet_service.cc:1467] Processing CreateTablet for tablet f602f24ba4f4464492b216cb6504ac85 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6c0ec6b40df5487f91555e90f8bfeadb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:23:45.269660 1941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f602f24ba4f4464492b216cb6504ac85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:45.269704 2205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f602f24ba4f4464492b216cb6504ac85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:45.269704 2479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f602f24ba4f4464492b216cb6504ac85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:45.270773 2658 tablet_bootstrap.cc:492] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da: Bootstrap starting.
I20260812 06:23:45.271157 2658 tablet_bootstrap.cc:654] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:45.271207 2649 tablet_bootstrap.cc:492] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: Bootstrap starting.
I20260812 06:23:45.271813 2658 tablet_bootstrap.cc:492] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da: No bootstrap required, opened a new log
I20260812 06:23:45.271863 2658 ts_tablet_manager.cc:1397] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:45.271896 2649 tablet_bootstrap.cc:654] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:45.272002 2658 raft_consensus.cc:348] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.272070 2658 raft_consensus.cc:374] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:45.272089 2658 raft_consensus.cc:729] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2aa67117cf2421cac941b25f3f457da, State: Initialized, Role: FOLLOWER
I20260812 06:23:45.272131 2658 consensus_queue.cc:260] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.272225 2658 ts_tablet_manager.cc:1428] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:45.272235 2647 tablet_bootstrap.cc:492] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6: Bootstrap starting.
I20260812 06:23:45.272265 2664 tablet_replica.cc:439] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } } }
I20260812 06:23:45.272351 2664 tablet_replica.cc:442] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:45.272749 2647 tablet_bootstrap.cc:654] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:45.273140 2649 tablet_bootstrap.cc:492] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: No bootstrap required, opened a new log
I20260812 06:23:45.273181 2649 ts_tablet_manager.cc:1397] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:23:45.273353 2647 tablet_bootstrap.cc:492] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6: No bootstrap required, opened a new log
I20260812 06:23:45.273320 2649 raft_consensus.cc:348] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.273391 2649 raft_consensus.cc:374] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:45.273402 2647 ts_tablet_manager.cc:1397] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:45.273409 2649 raft_consensus.cc:729] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daead66e493d40878b85844bb413e1df, State: Initialized, Role: FOLLOWER
I20260812 06:23:45.273458 2649 consensus_queue.cc:260] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.273550 2649 ts_tablet_manager.cc:1428] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:45.273558 2647 raft_consensus.cc:348] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.273617 2647 raft_consensus.cc:374] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:45.273634 2647 raft_consensus.cc:729] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23714d8ae3b4097b66be67f6ba0e0f6, State: Initialized, Role: FOLLOWER
I20260812 06:23:45.273626 2652 tablet_replica.cc:439] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } } }
I20260812 06:23:45.273682 2647 consensus_queue.cc:260] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.273734 2652 tablet_replica.cc:442] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:45.273770 2647 ts_tablet_manager.cc:1428] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:45.273845 2654 tablet_replica.cc:439] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } } }
I20260812 06:23:45.273948 2654 tablet_replica.cc:442] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:23:45.277606 2059 tablet.cc:2369] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:23:45.361029 2652 raft_consensus.cc:482] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:23:45.361130 2652 raft_consensus.cc:504] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.361480 2652 leader_election.cc:288] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2aa67117cf2421cac941b25f3f457da (127.30.15.65:42869), a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563)
W20260812 06:23:45.362154 2607 tablet.cc:2369] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:23:45.364578 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.361728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:43315 (local address 127.30.15.65:42869)
0812 06:23:45.361785 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.361787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.361798 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:23:45.361894 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.361895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.361906 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.361967 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:45.362137 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.362677 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.363790 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.364222 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.364282 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.364292 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.364459 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.364505 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:23:45.364593 2129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.361669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:42869 (local address 127.30.15.66:43315)
0812 06:23:45.361735 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.361749 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.361810 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.361976 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.361978 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.361980 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:45.362056 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.362058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.362765 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.362767 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.363703 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.363706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.364302 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.364303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.364396 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.364400 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.364443 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.364507 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 06:23:45.364915 1972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f602f24ba4f4464492b216cb6504ac85" candidate_uuid: "daead66e493d40878b85844bb413e1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2aa67117cf2421cac941b25f3f457da" is_pre_election: true
I20260812 06:23:45.365068 1972 raft_consensus.cc:2454] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daead66e493d40878b85844bb413e1df in term 0.
I20260812 06:23:45.365093 2694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.361669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:43563 (local address 127.30.15.66:53473)
0812 06:23:45.361958 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.361966 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.362010 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.362754 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.362755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.362757 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:45.362836 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.362838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.363480 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.363481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.364243 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.364245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.364834 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.364835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.364911 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.364915 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.364975 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.365013 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":100,"thread_start_us":132,"threads_started":1}
I20260812 06:23:45.365094 2639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.361743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:53473 (local address 127.30.15.67:43563)
0812 06:23:45.361792 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.361795 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.362023 (+ 228us) server_negotiation.cc:407] Connection header received
0812 06:23:45.362055 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.362056 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.362064 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.362120 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:45.362910 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.363405 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.364318 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.364747 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.364816 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.364823 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.364991 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.365032 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:23:45.365300 2111 leader_election.cc:302] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daead66e493d40878b85844bb413e1df, e2aa67117cf2421cac941b25f3f457da; no voters:
I20260812 06:23:45.365448 2652 raft_consensus.cc:2781] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:23:45.365499 2652 raft_consensus.cc:482] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:23:45.365518 2652 raft_consensus.cc:3037] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:45.365582 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f602f24ba4f4464492b216cb6504ac85" candidate_uuid: "daead66e493d40878b85844bb413e1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" is_pre_election: true
I20260812 06:23:45.365664 2516 raft_consensus.cc:2454] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daead66e493d40878b85844bb413e1df in term 0.
I20260812 06:23:45.366277 2652 raft_consensus.cc:504] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.366405 2652 leader_election.cc:288] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [CANDIDATE]: Term 1 election: Requested vote from peers e2aa67117cf2421cac941b25f3f457da (127.30.15.65:42869), a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563)
I20260812 06:23:45.366591 1972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f602f24ba4f4464492b216cb6504ac85" candidate_uuid: "daead66e493d40878b85844bb413e1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2aa67117cf2421cac941b25f3f457da"
I20260812 06:23:45.366602 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f602f24ba4f4464492b216cb6504ac85" candidate_uuid: "daead66e493d40878b85844bb413e1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6"
I20260812 06:23:45.366672 1972 raft_consensus.cc:3037] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:45.366672 2516 raft_consensus.cc:3037] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:45.367281 2516 raft_consensus.cc:2454] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daead66e493d40878b85844bb413e1df in term 1.
I20260812 06:23:45.367452 2112 leader_election.cc:302] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a23714d8ae3b4097b66be67f6ba0e0f6, daead66e493d40878b85844bb413e1df; no voters:
I20260812 06:23:45.367461 1972 raft_consensus.cc:2454] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daead66e493d40878b85844bb413e1df in term 1.
I20260812 06:23:45.367534 2652 raft_consensus.cc:2781] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:45.367697 2652 raft_consensus.cc:686] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [term 1 LEADER]: Becoming Leader. State: Replica: daead66e493d40878b85844bb413e1df, State: Running, Role: LEADER
I20260812 06:23:45.367774 2652 consensus_queue.cc:237] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.368204 2697 tablet_replica.cc:439] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: TxnStatusTablet state changed. Reason: New leader daead66e493d40878b85844bb413e1df. Latest consensus state: current_term: 1 leader_uuid: "daead66e493d40878b85844bb413e1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } } }
I20260812 06:23:45.368299 2697 tablet_replica.cc:442] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:23:45.368539 2699 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:23:45.368643 2699 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 06:23:45.368641 1648 catalog_manager.cc:5495] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df reported cstate change: term changed from 0 to 1, leader changed from <none> to daead66e493d40878b85844bb413e1df (127.30.15.66). New cstate: current_term: 1 leader_uuid: "daead66e493d40878b85844bb413e1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } health_report { overall_health: UNKNOWN } } }
I20260812 06:23:45.390578 2685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.388073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:38201 (local address 127.0.0.1:54590)
0812 06:23:45.388133 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.388145 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.388190 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.388441 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.388442 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.388443 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:23:45.388493 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.388495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.389109 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.389110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.389749 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.389751 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.390085 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.390086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.390154 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.390172 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:23:45.390411 (+ 239us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:23:45.390420 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.390465 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.390514 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 06:23:45.390573 2644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.388257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54590 (local address 127.30.15.66:38201)
0812 06:23:45.388312 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.388314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.388321 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:23:45.388346 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.388347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.388361 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.388421 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:45.388546 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.389034 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.389837 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.390024 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.390077 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.390253 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:45.390352 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:45.390418 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.390467 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.390490 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:23:45.392349 2516 raft_consensus.cc:1261] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Refusing update from remote peer daead66e493d40878b85844bb413e1df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:45.392419 1972 raft_consensus.cc:1261] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Refusing update from remote peer daead66e493d40878b85844bb413e1df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:45.392620 2697 consensus_queue.cc:1035] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:45.392730 2652 consensus_queue.cc:1035] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:45.393800 2664 tablet_replica.cc:439] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da: TxnStatusTablet state changed. Reason: New leader daead66e493d40878b85844bb413e1df. Latest consensus state: current_term: 1 leader_uuid: "daead66e493d40878b85844bb413e1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } } }
I20260812 06:23:45.393883 2664 tablet_replica.cc:442] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:45.393875 2654 tablet_replica.cc:439] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6: TxnStatusTablet state changed. Reason: New leader daead66e493d40878b85844bb413e1df. Latest consensus state: current_term: 1 leader_uuid: "daead66e493d40878b85844bb413e1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } } }
I20260812 06:23:45.393956 2654 tablet_replica.cc:442] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:45.394707 2697 tablet_replica.cc:439] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "daead66e493d40878b85844bb413e1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } } }
I20260812 06:23:45.394783 2697 tablet_replica.cc:442] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:23:45.394815 2664 tablet_replica.cc:439] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "daead66e493d40878b85844bb413e1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } } }
I20260812 06:23:45.394886 2664 tablet_replica.cc:442] T f602f24ba4f4464492b216cb6504ac85 P e2aa67117cf2421cac941b25f3f457da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:45.395140 2697 tablet_replica.cc:439] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "daead66e493d40878b85844bb413e1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } } }
I20260812 06:23:45.395213 2697 tablet_replica.cc:442] T f602f24ba4f4464492b216cb6504ac85 P daead66e493d40878b85844bb413e1df: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:23:45.395292 2703 mvcc.cc:205] Tried to move back new op lower bound from 7317568820804702208 to 7317568820706844672. Current Snapshot: MvccSnapshot[applied={T|T < 7317568820804702208}]
I20260812 06:23:45.395866 2704 mvcc.cc:205] Tried to move back new op lower bound from 7317568820804702208 to 7317568820706844672. Current Snapshot: MvccSnapshot[applied={T|T < 7317568820804702208}]
I20260812 06:23:45.395964 2654 tablet_replica.cc:439] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "daead66e493d40878b85844bb413e1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } } }
I20260812 06:23:45.396044 2654 tablet_replica.cc:442] T f602f24ba4f4464492b216cb6504ac85 P a23714d8ae3b4097b66be67f6ba0e0f6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:23:45.397477 2706 mvcc.cc:205] Tried to move back new op lower bound from 7317568820804702208 to 7317568820706844672. Current Snapshot: MvccSnapshot[applied={T|T < 7317568820804702208}]
I20260812 06:23:45.399626 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.397300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47550 (local address 127.30.15.65:42869)
0812 06:23:45.397334 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.397336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.397360 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:23:45.397426 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.397427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.397440 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.397506 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:45.397664 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.398164 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.398911 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.399101 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.399159 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.399339 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:45.399434 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:45.399498 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.399545 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.399565 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:23:45.404407 2644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.401887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:33245 (local address 127.30.15.66:38201)
0812 06:23:45.401926 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.401928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.402012 (+ 84us) server_negotiation.cc:407] Connection header received
0812 06:23:45.402038 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.402039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.402047 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.402109 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:45.402213 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.402906 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.403666 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.403960 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.404026 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.404207 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:45.404237 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:45.404282 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.404325 (+ 43us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.404344 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:23:45.404414 2729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.401796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:38201 (local address 127.30.15.65:33245)
0812 06:23:45.401944 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.401954 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.402007 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.402110 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.402111 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.402112 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:23:45.402164 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.402165 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.402989 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.402989 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.403592 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.403595 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.404049 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.404051 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.404110 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.404124 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:23:45.404286 (+ 162us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:23:45.404287 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.404313 (+ 26us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.404347 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":109,"threads_started":1}
I20260812 06:23:45.406612 2516 raft_consensus.cc:1261] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Refusing update from remote peer e2aa67117cf2421cac941b25f3f457da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:45.406702 2239 raft_consensus.cc:1261] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Refusing update from remote peer e2aa67117cf2421cac941b25f3f457da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:45.406975 2664 consensus_queue.cc:1035] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:45.407101 2671 consensus_queue.cc:1035] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [LEADER]: Connected to new peer: Peer: permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:45.414875 2646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.412727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:37577 (local address 127.30.15.65:42869)
0812 06:23:45.412774 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.412775 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.412782 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:23:45.412800 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.412801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.412807 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.412850 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:45.412995 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.413447 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.414176 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.414440 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.414496 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.414666 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:45.414698 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:45.414740 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.414799 (+ 59us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.414816 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:23:45.414902 2344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.412569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:42869 (local address 127.30.15.66:37577)
0812 06:23:45.412634 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.412643 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.412678 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.412871 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.412871 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.412873 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:23:45.412942 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.412944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.413514 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.413515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.414106 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.414108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.414520 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.414521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.414587 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.414600 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:23:45.414756 (+ 156us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:23:45.414757 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.414796 (+ 39us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.414835 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 06:23:45.428369 1648 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:45.428474 1648 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:45.429172 1648 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9: Sending DeleteTablet for 3 replicas of tablet df9da14c92784d3ea221fd42ffeac027
I20260812 06:23:45.429446 2205 tablet_service.cc:1514] Processing DeleteTablet for tablet df9da14c92784d3ea221fd42ffeac027 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:45 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:54574
I20260812 06:23:45.429490 1941 tablet_service.cc:1514] Processing DeleteTablet for tablet df9da14c92784d3ea221fd42ffeac027 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:45 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:47546
I20260812 06:23:45.429733 2748 tablet_replica.cc:330] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df: stopping tablet replica
I20260812 06:23:45.429855 2751 tablet_replica.cc:330] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da: stopping tablet replica
I20260812 06:23:45.429836 2479 tablet_service.cc:1514] Processing DeleteTablet for tablet df9da14c92784d3ea221fd42ffeac027 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:45 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:58884
I20260812 06:23:45.430008 2748 raft_consensus.cc:2229] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:45.430133 2751 raft_consensus.cc:2229] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:23:45.430272 2751 raft_consensus.cc:2258] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:45.430236 1648 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52598:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 06:23:45.430362 2748 raft_consensus.cc:2258] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 06:23:45.430375 1648 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:23:45.430823 2748 ts_tablet_manager.cc:1905] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:45.431340 2751 ts_tablet_manager.cc:1905] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:45.431630 2205 tablet_service.cc:1467] Processing CreateTablet for tablet be59eada09cd43a6893188b55fc81a92 (DEFAULT_TABLE table=test-table [id=1ecab19db9c44d7c86554df6e34f9f34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:45.431749 2205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be59eada09cd43a6893188b55fc81a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:45.433049 2748 ts_tablet_manager.cc:1918] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:23:45.433384 1941 tablet_service.cc:1467] Processing CreateTablet for tablet be59eada09cd43a6893188b55fc81a92 (DEFAULT_TABLE table=test-table [id=1ecab19db9c44d7c86554df6e34f9f34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:45.433504 1941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be59eada09cd43a6893188b55fc81a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:45.434782 2658 tablet_bootstrap.cc:492] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da: Bootstrap starting.
I20260812 06:23:45.434885 2751 ts_tablet_manager.cc:1918] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:23:45.434952 2751 log.cc:1196] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/wal/wals/df9da14c92784d3ea221fd42ffeac027
I20260812 06:23:45.435199 2658 tablet_bootstrap.cc:654] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:45.435246 2751 ts_tablet_manager.cc:1939] T df9da14c92784d3ea221fd42ffeac027 P e2aa67117cf2421cac941b25f3f457da: Deleting consensus metadata
I20260812 06:23:45.433051 2649 tablet_bootstrap.cc:492] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df: Bootstrap starting.
I20260812 06:23:45.435758 1621 catalog_manager.cc:4841] TS e2aa67117cf2421cac941b25f3f457da (127.30.15.65:42869): tablet df9da14c92784d3ea221fd42ffeac027 (table test-table [id=2da7d5d59e694d6da7d453ec8c89ee18]) successfully deleted
I20260812 06:23:45.435842 2649 tablet_bootstrap.cc:654] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:45.436007 2479 tablet_service.cc:1467] Processing CreateTablet for tablet be59eada09cd43a6893188b55fc81a92 (DEFAULT_TABLE table=test-table [id=1ecab19db9c44d7c86554df6e34f9f34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:45.436118 2479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be59eada09cd43a6893188b55fc81a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:45.436223 2748 log.cc:1196] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/df9da14c92784d3ea221fd42ffeac027
I20260812 06:23:45.436481 2748 ts_tablet_manager.cc:1939] T df9da14c92784d3ea221fd42ffeac027 P daead66e493d40878b85844bb413e1df: Deleting consensus metadata
I20260812 06:23:45.436849 1621 catalog_manager.cc:4841] TS daead66e493d40878b85844bb413e1df (127.30.15.66:38201): tablet df9da14c92784d3ea221fd42ffeac027 (table test-table [id=2da7d5d59e694d6da7d453ec8c89ee18]) successfully deleted
I20260812 06:23:45.437254 2649 tablet_bootstrap.cc:492] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df: No bootstrap required, opened a new log
I20260812 06:23:45.437294 2649 ts_tablet_manager.cc:1397] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 06:23:45.437414 2649 raft_consensus.cc:348] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.437469 2649 raft_consensus.cc:374] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:45.437487 2649 raft_consensus.cc:729] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daead66e493d40878b85844bb413e1df, State: Initialized, Role: FOLLOWER
I20260812 06:23:45.437492 2647 tablet_bootstrap.cc:492] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6: Bootstrap starting.
I20260812 06:23:45.437525 2649 consensus_queue.cc:260] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.437613 2649 ts_tablet_manager.cc:1428] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:45.437875 2647 tablet_bootstrap.cc:654] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:45.438177 2752 tablet_replica.cc:330] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6: stopping tablet replica
I20260812 06:23:45.438278 2752 raft_consensus.cc:2229] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:45.438326 2752 raft_consensus.cc:2258] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:45.439014 2752 ts_tablet_manager.cc:1905] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:45.439651 2658 tablet_bootstrap.cc:492] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da: No bootstrap required, opened a new log
I20260812 06:23:45.439706 2658 ts_tablet_manager.cc:1397] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 06:23:45.439837 2658 raft_consensus.cc:348] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.439904 2658 raft_consensus.cc:374] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:45.439930 2658 raft_consensus.cc:729] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2aa67117cf2421cac941b25f3f457da, State: Initialized, Role: FOLLOWER
I20260812 06:23:45.439970 2658 consensus_queue.cc:260] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.440047 2658 ts_tablet_manager.cc:1428] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:45.441313 2752 ts_tablet_manager.cc:1918] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:23:45.441387 2752 log.cc:1196] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/df9da14c92784d3ea221fd42ffeac027
I20260812 06:23:45.441676 2752 ts_tablet_manager.cc:1939] T df9da14c92784d3ea221fd42ffeac027 P a23714d8ae3b4097b66be67f6ba0e0f6: Deleting consensus metadata
I20260812 06:23:45.442130 2647 tablet_bootstrap.cc:492] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6: No bootstrap required, opened a new log
I20260812 06:23:45.442087 1622 catalog_manager.cc:4841] TS a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563): tablet df9da14c92784d3ea221fd42ffeac027 (table test-table [id=2da7d5d59e694d6da7d453ec8c89ee18]) successfully deleted
I20260812 06:23:45.442174 2647 ts_tablet_manager.cc:1397] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 06:23:45.442296 2647 raft_consensus.cc:348] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.442350 2647 raft_consensus.cc:374] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:45.442368 2647 raft_consensus.cc:729] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23714d8ae3b4097b66be67f6ba0e0f6, State: Initialized, Role: FOLLOWER
I20260812 06:23:45.442414 2647 consensus_queue.cc:260] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.442494 2647 ts_tablet_manager.cc:1428] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:45.621322 2652 raft_consensus.cc:482] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:23:45.621425 2652 raft_consensus.cc:504] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.621599 2652 leader_election.cc:288] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2aa67117cf2421cac941b25f3f457da (127.30.15.65:42869), a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563)
I20260812 06:23:45.621784 1972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be59eada09cd43a6893188b55fc81a92" candidate_uuid: "daead66e493d40878b85844bb413e1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2aa67117cf2421cac941b25f3f457da" is_pre_election: true
I20260812 06:23:45.621785 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be59eada09cd43a6893188b55fc81a92" candidate_uuid: "daead66e493d40878b85844bb413e1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" is_pre_election: true
I20260812 06:23:45.621898 1972 raft_consensus.cc:2454] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daead66e493d40878b85844bb413e1df in term 0.
I20260812 06:23:45.621904 2516 raft_consensus.cc:2454] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate daead66e493d40878b85844bb413e1df in term 0.
I20260812 06:23:45.622100 2112 leader_election.cc:302] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a23714d8ae3b4097b66be67f6ba0e0f6, daead66e493d40878b85844bb413e1df; no voters:
I20260812 06:23:45.622205 2652 raft_consensus.cc:2781] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:23:45.622249 2652 raft_consensus.cc:482] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:23:45.622267 2652 raft_consensus.cc:3037] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:45.622895 2652 raft_consensus.cc:504] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.623005 2652 leader_election.cc:288] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [CANDIDATE]: Term 1 election: Requested vote from peers e2aa67117cf2421cac941b25f3f457da (127.30.15.65:42869), a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563)
I20260812 06:23:45.623154 1972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be59eada09cd43a6893188b55fc81a92" candidate_uuid: "daead66e493d40878b85844bb413e1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2aa67117cf2421cac941b25f3f457da"
I20260812 06:23:45.623202 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be59eada09cd43a6893188b55fc81a92" candidate_uuid: "daead66e493d40878b85844bb413e1df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6"
I20260812 06:23:45.623242 1972 raft_consensus.cc:3037] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:45.623277 2516 raft_consensus.cc:3037] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:45.624025 2516 raft_consensus.cc:2454] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daead66e493d40878b85844bb413e1df in term 1.
I20260812 06:23:45.624083 1972 raft_consensus.cc:2454] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate daead66e493d40878b85844bb413e1df in term 1.
I20260812 06:23:45.624233 2112 leader_election.cc:302] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a23714d8ae3b4097b66be67f6ba0e0f6, daead66e493d40878b85844bb413e1df; no voters:
I20260812 06:23:45.624332 2652 raft_consensus.cc:2781] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:45.624378 2652 raft_consensus.cc:686] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 1 LEADER]: Becoming Leader. State: Replica: daead66e493d40878b85844bb413e1df, State: Running, Role: LEADER
I20260812 06:23:45.624429 2652 consensus_queue.cc:237] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:45.625003 1648 catalog_manager.cc:5495] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df reported cstate change: term changed from 0 to 1, leader changed from <none> to daead66e493d40878b85844bb413e1df (127.30.15.66). New cstate: current_term: 1 leader_uuid: "daead66e493d40878b85844bb413e1df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } health_report { overall_health: UNKNOWN } } }
I20260812 06:23:45.669131 2644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.667248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54598 (local address 127.30.15.66:38201)
0812 06:23:45.667304 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.667306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.667315 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:23:45.667360 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.667361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.667369 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.667410 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:45.667497 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.667954 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.668658 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.668842 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.668893 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.668976 (+ 83us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:45.669001 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:45.669031 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.669060 (+ 29us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.669077 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:23:45.672850 2344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.671000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:38201 (local address 127.30.15.66:53227)
0812 06:23:45.671049 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:45.671061 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:45.671106 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:45.671215 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:45.671215 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:45.671216 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:23:45.671248 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.671249 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.671818 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.671819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.672324 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:45.672325 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.672600 (+ 275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.672601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:45.672633 (+ 32us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.672636 (+ 3us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:23:45.672733 (+ 97us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:23:45.672734 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:23:45.672766 (+ 32us) client_negotiation.cc:240] Negotiation successful
0812 06:23:45.672795 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:23:45.672843 2644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:45.671092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:53227 (local address 127.30.15.66:38201)
0812 06:23:45.671133 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:45.671135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:45.671141 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:23:45.671158 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:45.671159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:45.671166 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:45.671207 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:45.671342 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.671766 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.672385 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:45.672555 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:45.672599 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:45.672676 (+ 77us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:45.672698 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:45.672729 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:45.672771 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 06:23:45.672788 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:23:45.674530 2516 raft_consensus.cc:1261] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Refusing update from remote peer daead66e493d40878b85844bb413e1df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:45.674662 1972 raft_consensus.cc:1261] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Refusing update from remote peer daead66e493d40878b85844bb413e1df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:45.674719 2697 consensus_queue.cc:1035] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:45.674918 2697 consensus_queue.cc:1035] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:23:45.679256 2703 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 06:23:47.196848 1649 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:47.196954 1649 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:47.197736 1649 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9: Sending DeleteTablet for 3 replicas of tablet be59eada09cd43a6893188b55fc81a92
I20260812 06:23:47.197999 2479 tablet_service.cc:1514] Processing DeleteTablet for tablet be59eada09cd43a6893188b55fc81a92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:47 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:58884
I20260812 06:23:47.198037 2204 tablet_service.cc:1514] Processing DeleteTablet for tablet be59eada09cd43a6893188b55fc81a92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:47 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:54574
I20260812 06:23:47.198046 1941 tablet_service.cc:1514] Processing DeleteTablet for tablet be59eada09cd43a6893188b55fc81a92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:47 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:47546
I20260812 06:23:47.198208 2812 tablet_replica.cc:330] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6: stopping tablet replica
I20260812 06:23:47.198257 2812 raft_consensus.cc:2229] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:47.198288 2812 raft_consensus.cc:2258] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:47.198542 2812 ts_tablet_manager.cc:1905] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:47.199394 2815 tablet_replica.cc:330] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df: stopping tablet replica
I20260812 06:23:47.199445 2815 raft_consensus.cc:2229] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:23:47.199507 2815 raft_consensus.cc:2258] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:47.199723 2815 ts_tablet_manager.cc:1905] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:47.200205 2812 ts_tablet_manager.cc:1918] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:23:47.200258 2812 log.cc:1196] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/be59eada09cd43a6893188b55fc81a92
I20260812 06:23:47.200505 2812 ts_tablet_manager.cc:1939] T be59eada09cd43a6893188b55fc81a92 P a23714d8ae3b4097b66be67f6ba0e0f6: Deleting consensus metadata
I20260812 06:23:47.200810 1622 catalog_manager.cc:4841] TS a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563): tablet be59eada09cd43a6893188b55fc81a92 (table test-table [id=1ecab19db9c44d7c86554df6e34f9f34]) successfully deleted
I20260812 06:23:47.201238 2815 ts_tablet_manager.cc:1918] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:23:47.201303 2815 log.cc:1196] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/be59eada09cd43a6893188b55fc81a92
I20260812 06:23:47.201524 2815 ts_tablet_manager.cc:1939] T be59eada09cd43a6893188b55fc81a92 P daead66e493d40878b85844bb413e1df: Deleting consensus metadata
I20260812 06:23:47.201627 2818 tablet_replica.cc:330] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da: stopping tablet replica
I20260812 06:23:47.201690 2818 raft_consensus.cc:2229] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:47.201735 2818 raft_consensus.cc:2258] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:47.201978 2818 ts_tablet_manager.cc:1905] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:47.201972 1621 catalog_manager.cc:4841] TS daead66e493d40878b85844bb413e1df (127.30.15.66:38201): tablet be59eada09cd43a6893188b55fc81a92 (table test-table [id=1ecab19db9c44d7c86554df6e34f9f34]) successfully deleted
I20260812 06:23:47.203169 2818 ts_tablet_manager.cc:1918] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:23:47.203235 2818 log.cc:1196] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/wal/wals/be59eada09cd43a6893188b55fc81a92
I20260812 06:23:47.203439 2818 ts_tablet_manager.cc:1939] T be59eada09cd43a6893188b55fc81a92 P e2aa67117cf2421cac941b25f3f457da: Deleting consensus metadata
I20260812 06:23:47.203801 1621 catalog_manager.cc:4841] TS e2aa67117cf2421cac941b25f3f457da (127.30.15.65:42869): tablet be59eada09cd43a6893188b55fc81a92 (table test-table [id=1ecab19db9c44d7c86554df6e34f9f34]) successfully deleted
Aug 12 06:23:47 dist-test-slave-gjrz krb5kdc[1551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515827, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:23:47 dist-test-slave-gjrz krb5kdc[1551](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515827, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:47.232719 2833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:47.215099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52612 (local address 127.30.15.126:36123)
0812 06:23:47.215220 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:47.215222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:47.215246 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:23:47.215343 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:47.215344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:47.215355 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:47.215409 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:47.215955 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.216465 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.217168 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.217364 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.217417 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:47.230369 (+ 12952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:47.230371 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:47.230371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:47.230378 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:47.231709 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:47.232018 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:47.232019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:47.232020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:47.232080 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:47.232246 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:47.232246 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:47.232247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:47.232356 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:47.232444 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:47.232549 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 06:23:47.232627 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":69,"threads_started":1}
I20260812 06:23:47.233974 1649 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52612:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:23:47.234126 1649 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:23:47.235472 1941 tablet_service.cc:1467] Processing CreateTablet for tablet f1121381ccb64b4c9358783eb597cd1c (DEFAULT_TABLE table=test-table [id=184bd752b2b547e7872a105b5250db68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:47.235503 2204 tablet_service.cc:1467] Processing CreateTablet for tablet f1121381ccb64b4c9358783eb597cd1c (DEFAULT_TABLE table=test-table [id=184bd752b2b547e7872a105b5250db68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:47.235606 1941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1121381ccb64b4c9358783eb597cd1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:47.235574 2479 tablet_service.cc:1467] Processing CreateTablet for tablet f1121381ccb64b4c9358783eb597cd1c (DEFAULT_TABLE table=test-table [id=184bd752b2b547e7872a105b5250db68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:47.235618 2204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1121381ccb64b4c9358783eb597cd1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:47.235699 2479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1121381ccb64b4c9358783eb597cd1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:47.236647 2834 tablet_bootstrap.cc:492] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6: Bootstrap starting.
I20260812 06:23:47.236932 2836 tablet_bootstrap.cc:492] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da: Bootstrap starting.
I20260812 06:23:47.237114 2834 tablet_bootstrap.cc:654] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:47.237211 2837 tablet_bootstrap.cc:492] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df: Bootstrap starting.
I20260812 06:23:47.237344 2836 tablet_bootstrap.cc:654] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:47.237547 2837 tablet_bootstrap.cc:654] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:47.237849 2834 tablet_bootstrap.cc:492] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6: No bootstrap required, opened a new log
I20260812 06:23:47.237906 2834 ts_tablet_manager.cc:1397] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:47.237944 2836 tablet_bootstrap.cc:492] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da: No bootstrap required, opened a new log
I20260812 06:23:47.237989 2836 ts_tablet_manager.cc:1397] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:47.238021 2834 raft_consensus.cc:348] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.238080 2834 raft_consensus.cc:374] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:47.238093 2834 raft_consensus.cc:729] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23714d8ae3b4097b66be67f6ba0e0f6, State: Initialized, Role: FOLLOWER
I20260812 06:23:47.238118 2837 tablet_bootstrap.cc:492] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df: No bootstrap required, opened a new log
I20260812 06:23:47.238101 2836 raft_consensus.cc:348] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.238129 2834 consensus_queue.cc:260] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.238153 2837 ts_tablet_manager.cc:1397] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:47.238165 2836 raft_consensus.cc:374] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:47.238184 2836 raft_consensus.cc:729] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2aa67117cf2421cac941b25f3f457da, State: Initialized, Role: FOLLOWER
I20260812 06:23:47.238229 2836 consensus_queue.cc:260] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.238277 2834 ts_tablet_manager.cc:1428] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:47.238382 2836 ts_tablet_manager.cc:1428] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:47.238332 2837 raft_consensus.cc:348] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.238525 2837 raft_consensus.cc:374] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:47.238548 2837 raft_consensus.cc:729] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daead66e493d40878b85844bb413e1df, State: Initialized, Role: FOLLOWER
I20260812 06:23:47.238612 2837 consensus_queue.cc:260] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.238803 2837 ts_tablet_manager.cc:1428] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:47.311612 2844 raft_consensus.cc:482] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:23:47.311692 2844 raft_consensus.cc:504] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.311854 2844 leader_election.cc:288] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers daead66e493d40878b85844bb413e1df (127.30.15.66:38201), a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563)
I20260812 06:23:47.312023 2239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1121381ccb64b4c9358783eb597cd1c" candidate_uuid: "e2aa67117cf2421cac941b25f3f457da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daead66e493d40878b85844bb413e1df" is_pre_election: true
I20260812 06:23:47.312057 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1121381ccb64b4c9358783eb597cd1c" candidate_uuid: "e2aa67117cf2421cac941b25f3f457da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" is_pre_election: true
I20260812 06:23:47.312124 2239 raft_consensus.cc:2454] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2aa67117cf2421cac941b25f3f457da in term 0.
I20260812 06:23:47.312140 2516 raft_consensus.cc:2454] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2aa67117cf2421cac941b25f3f457da in term 0.
I20260812 06:23:47.312279 1834 leader_election.cc:302] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daead66e493d40878b85844bb413e1df, e2aa67117cf2421cac941b25f3f457da; no voters:
I20260812 06:23:47.312371 2844 raft_consensus.cc:2781] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:23:47.312422 2844 raft_consensus.cc:482] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:23:47.312436 2844 raft_consensus.cc:3037] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:47.313120 2844 raft_consensus.cc:504] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.313241 2844 leader_election.cc:288] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [CANDIDATE]: Term 1 election: Requested vote from peers daead66e493d40878b85844bb413e1df (127.30.15.66:38201), a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563)
I20260812 06:23:47.313383 2239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1121381ccb64b4c9358783eb597cd1c" candidate_uuid: "e2aa67117cf2421cac941b25f3f457da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daead66e493d40878b85844bb413e1df"
I20260812 06:23:47.313400 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1121381ccb64b4c9358783eb597cd1c" candidate_uuid: "e2aa67117cf2421cac941b25f3f457da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6"
I20260812 06:23:47.313458 2239 raft_consensus.cc:3037] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:47.313465 2516 raft_consensus.cc:3037] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:47.314214 2516 raft_consensus.cc:2454] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2aa67117cf2421cac941b25f3f457da in term 1.
I20260812 06:23:47.314214 2239 raft_consensus.cc:2454] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2aa67117cf2421cac941b25f3f457da in term 1.
I20260812 06:23:47.314373 1834 leader_election.cc:302] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: daead66e493d40878b85844bb413e1df, e2aa67117cf2421cac941b25f3f457da; no voters:
I20260812 06:23:47.314462 2844 raft_consensus.cc:2781] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:47.314631 2844 raft_consensus.cc:686] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 1 LEADER]: Becoming Leader. State: Replica: e2aa67117cf2421cac941b25f3f457da, State: Running, Role: LEADER
I20260812 06:23:47.314684 2844 consensus_queue.cc:237] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.315292 1649 catalog_manager.cc:5495] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da reported cstate change: term changed from 0 to 1, leader changed from <none> to e2aa67117cf2421cac941b25f3f457da (127.30.15.65). New cstate: current_term: 1 leader_uuid: "e2aa67117cf2421cac941b25f3f457da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } health_report { overall_health: UNKNOWN } } }
I20260812 06:23:47.331390 2849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:47.329417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47564 (local address 127.30.15.65:42869)
0812 06:23:47.329559 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:47.329560 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:47.329569 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:23:47.329590 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:47.329591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:47.329601 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:47.329651 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:47.329747 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.330224 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.330885 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.331063 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.331116 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:47.331198 (+ 82us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:47.331223 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:47.331253 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:47.331318 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 06:23:47.331334 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":84,"threads_started":1}
I20260812 06:23:47.333535 2516 raft_consensus.cc:1261] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Refusing update from remote peer e2aa67117cf2421cac941b25f3f457da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:47.333556 2239 raft_consensus.cc:1261] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Refusing update from remote peer e2aa67117cf2421cac941b25f3f457da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:47.333732 2845 consensus_queue.cc:1035] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [LEADER]: Connected to new peer: Peer: permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:47.333842 2844 consensus_queue.cc:1035] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [LEADER]: Connected to new peer: Peer: permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:47.343509 1647 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:47.343592 1647 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:47.344087 1647 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9: Sending DeleteTablet for 3 replicas of tablet f1121381ccb64b4c9358783eb597cd1c
I20260812 06:23:47.344295 1941 tablet_service.cc:1514] Processing DeleteTablet for tablet f1121381ccb64b4c9358783eb597cd1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:47 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:47546
I20260812 06:23:47.344317 2479 tablet_service.cc:1514] Processing DeleteTablet for tablet f1121381ccb64b4c9358783eb597cd1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:47 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:58884
I20260812 06:23:47.344408 2818 tablet_replica.cc:330] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da: stopping tablet replica
I20260812 06:23:47.344416 2812 tablet_replica.cc:330] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6: stopping tablet replica
I20260812 06:23:47.344417 2204 tablet_service.cc:1514] Processing DeleteTablet for tablet f1121381ccb64b4c9358783eb597cd1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:47 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:54574
I20260812 06:23:47.344466 2812 raft_consensus.cc:2229] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:47.344468 2818 raft_consensus.cc:2229] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:23:47.344496 2815 tablet_replica.cc:330] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df: stopping tablet replica
I20260812 06:23:47.344506 2812 raft_consensus.cc:2258] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:47.344513 2818 raft_consensus.cc:2258] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:47.344543 2815 raft_consensus.cc:2229] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:47.344568 2815 raft_consensus.cc:2258] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:47.344779 2812 ts_tablet_manager.cc:1905] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:47.344821 2815 ts_tablet_manager.cc:1905] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:47.344939 1647 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52612:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 06:23:47.345065 2818 ts_tablet_manager.cc:1905] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 06:23:47.345073 1647 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:23:47.346378 2812 ts_tablet_manager.cc:1918] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:23:47.346406 2815 ts_tablet_manager.cc:1918] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:23:47.346438 2812 log.cc:1196] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/f1121381ccb64b4c9358783eb597cd1c
I20260812 06:23:47.346447 2815 log.cc:1196] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/f1121381ccb64b4c9358783eb597cd1c
I20260812 06:23:47.346509 2818 ts_tablet_manager.cc:1918] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:23:47.346581 2818 log.cc:1196] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-0/wal/wals/f1121381ccb64b4c9358783eb597cd1c
I20260812 06:23:47.346644 2812 ts_tablet_manager.cc:1939] T f1121381ccb64b4c9358783eb597cd1c P a23714d8ae3b4097b66be67f6ba0e0f6: Deleting consensus metadata
I20260812 06:23:47.346644 2815 ts_tablet_manager.cc:1939] T f1121381ccb64b4c9358783eb597cd1c P daead66e493d40878b85844bb413e1df: Deleting consensus metadata
I20260812 06:23:47.346771 2818 ts_tablet_manager.cc:1939] T f1121381ccb64b4c9358783eb597cd1c P e2aa67117cf2421cac941b25f3f457da: Deleting consensus metadata
I20260812 06:23:47.347014 1622 catalog_manager.cc:4841] TS a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563): tablet f1121381ccb64b4c9358783eb597cd1c (table test-table [id=184bd752b2b547e7872a105b5250db68]) successfully deleted
I20260812 06:23:47.347113 1621 catalog_manager.cc:4841] TS e2aa67117cf2421cac941b25f3f457da (127.30.15.65:42869): tablet f1121381ccb64b4c9358783eb597cd1c (table test-table [id=184bd752b2b547e7872a105b5250db68]) successfully deleted
I20260812 06:23:47.347325 1621 catalog_manager.cc:4841] TS daead66e493d40878b85844bb413e1df (127.30.15.66:38201): tablet f1121381ccb64b4c9358783eb597cd1c (table test-table [id=184bd752b2b547e7872a105b5250db68]) successfully deleted
I20260812 06:23:47.347625 1941 tablet_service.cc:1467] Processing CreateTablet for tablet 703752f5c17b4674a6a66dd830246641 (DEFAULT_TABLE table=test-table [id=04397f73be124b7184332997172dbfc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:47.347633 2204 tablet_service.cc:1467] Processing CreateTablet for tablet 703752f5c17b4674a6a66dd830246641 (DEFAULT_TABLE table=test-table [id=04397f73be124b7184332997172dbfc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:47.347723 1941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 703752f5c17b4674a6a66dd830246641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:47.347729 2204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 703752f5c17b4674a6a66dd830246641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:47.348500 2836 tablet_bootstrap.cc:492] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da: Bootstrap starting.
I20260812 06:23:47.348532 2837 tablet_bootstrap.cc:492] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df: Bootstrap starting.
I20260812 06:23:47.348574 2479 tablet_service.cc:1467] Processing CreateTablet for tablet 703752f5c17b4674a6a66dd830246641 (DEFAULT_TABLE table=test-table [id=04397f73be124b7184332997172dbfc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:47.348665 2479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 703752f5c17b4674a6a66dd830246641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:47.348790 2836 tablet_bootstrap.cc:654] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:47.348839 2837 tablet_bootstrap.cc:654] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:47.349315 2836 tablet_bootstrap.cc:492] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da: No bootstrap required, opened a new log
I20260812 06:23:47.349359 2837 tablet_bootstrap.cc:492] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df: No bootstrap required, opened a new log
I20260812 06:23:47.349363 2836 ts_tablet_manager.cc:1397] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:47.349391 2837 ts_tablet_manager.cc:1397] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260812 06:23:47.349462 2837 raft_consensus.cc:348] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.349454 2836 raft_consensus.cc:348] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.349503 2837 raft_consensus.cc:374] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:47.349507 2836 raft_consensus.cc:374] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:47.349514 2837 raft_consensus.cc:729] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daead66e493d40878b85844bb413e1df, State: Initialized, Role: FOLLOWER
I20260812 06:23:47.349524 2836 raft_consensus.cc:729] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2aa67117cf2421cac941b25f3f457da, State: Initialized, Role: FOLLOWER
I20260812 06:23:47.349550 2837 consensus_queue.cc:260] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.349562 2836 consensus_queue.cc:260] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.349629 2837 ts_tablet_manager.cc:1428] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:47.349643 2836 ts_tablet_manager.cc:1428] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:47.349859 2834 tablet_bootstrap.cc:492] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6: Bootstrap starting.
I20260812 06:23:47.350288 2834 tablet_bootstrap.cc:654] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:47.350836 2834 tablet_bootstrap.cc:492] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6: No bootstrap required, opened a new log
I20260812 06:23:47.350889 2834 ts_tablet_manager.cc:1397] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:47.351033 2834 raft_consensus.cc:348] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.351102 2834 raft_consensus.cc:374] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:47.351128 2834 raft_consensus.cc:729] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a23714d8ae3b4097b66be67f6ba0e0f6, State: Initialized, Role: FOLLOWER
I20260812 06:23:47.351167 2834 consensus_queue.cc:260] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.351249 2834 ts_tablet_manager.cc:1428] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:47.354408 2843 raft_consensus.cc:482] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:23:47.354460 2843 raft_consensus.cc:504] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.354691 2843 leader_election.cc:288] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2aa67117cf2421cac941b25f3f457da (127.30.15.65:42869), daead66e493d40878b85844bb413e1df (127.30.15.66:38201)
I20260812 06:23:47.357508 2849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:47.354877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:35539 (local address 127.30.15.65:42869)
0812 06:23:47.354920 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:47.354922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:47.354976 (+ 54us) server_negotiation.cc:407] Connection header received
0812 06:23:47.355029 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:47.355030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:47.355039 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:47.355101 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:47.355235 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.355746 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.356859 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.357216 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.357276 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:47.357286 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:47.357415 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 06:23:47.357450 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:23:47.357544 2860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:47.354816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:42869 (local address 127.30.15.67:35539)
0812 06:23:47.354911 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:47.354921 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:47.354978 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:47.355107 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:47.355109 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:47.355111 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:47.355180 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:47.355181 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.355821 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.355822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:47.356782 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:47.356785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.357283 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.357284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:47.357357 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:47.357361 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:23:47.357405 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:23:47.357445 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78,"mutex_wait_us":2,"thread_start_us":49,"threads_started":1}
I20260812 06:23:47.357544 2866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:47.355003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:35417 (local address 127.30.15.66:38201)
0812 06:23:47.355094 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:47.355096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:47.355120 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:23:47.355173 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:47.355174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:47.355183 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:47.355241 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:47.355390 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.355844 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.356857 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.357235 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.357298 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:47.357306 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:47.357441 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 06:23:47.357482 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72,"thread_start_us":50,"threads_started":1}
I20260812 06:23:47.357568 2864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:47.354959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:38201 (local address 127.30.15.67:35417)
0812 06:23:47.355075 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:47.355084 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:47.355131 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:47.355242 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:47.355243 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:47.355245 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:47.355333 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:47.355335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.355953 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.355954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:47.356779 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:47.356782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.357305 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.357306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:47.357385 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:47.357388 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:23:47.357430 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 06:23:47.357469 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":70,"threads_started":1}
I20260812 06:23:47.357803 2239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "703752f5c17b4674a6a66dd830246641" candidate_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daead66e493d40878b85844bb413e1df" is_pre_election: true
I20260812 06:23:47.357863 2239 raft_consensus.cc:2454] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a23714d8ae3b4097b66be67f6ba0e0f6 in term 0.
I20260812 06:23:47.357867 1972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "703752f5c17b4674a6a66dd830246641" candidate_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2aa67117cf2421cac941b25f3f457da" is_pre_election: true
I20260812 06:23:47.357941 1972 raft_consensus.cc:2454] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a23714d8ae3b4097b66be67f6ba0e0f6 in term 0.
I20260812 06:23:47.358052 2386 leader_election.cc:302] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a23714d8ae3b4097b66be67f6ba0e0f6, daead66e493d40878b85844bb413e1df; no voters:
I20260812 06:23:47.358174 2843 raft_consensus.cc:2781] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:23:47.358211 2843 raft_consensus.cc:482] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:23:47.358228 2843 raft_consensus.cc:3037] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:47.358732 2843 raft_consensus.cc:504] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.358827 2843 leader_election.cc:288] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [CANDIDATE]: Term 1 election: Requested vote from peers e2aa67117cf2421cac941b25f3f457da (127.30.15.65:42869), daead66e493d40878b85844bb413e1df (127.30.15.66:38201)
I20260812 06:23:47.358963 1972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "703752f5c17b4674a6a66dd830246641" candidate_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2aa67117cf2421cac941b25f3f457da"
I20260812 06:23:47.359035 1972 raft_consensus.cc:3037] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:47.359035 2239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "703752f5c17b4674a6a66dd830246641" candidate_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daead66e493d40878b85844bb413e1df"
I20260812 06:23:47.359086 2239 raft_consensus.cc:3037] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:47.359738 2239 raft_consensus.cc:2454] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a23714d8ae3b4097b66be67f6ba0e0f6 in term 1.
I20260812 06:23:47.359738 1972 raft_consensus.cc:2454] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a23714d8ae3b4097b66be67f6ba0e0f6 in term 1.
I20260812 06:23:47.359885 2386 leader_election.cc:302] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a23714d8ae3b4097b66be67f6ba0e0f6, daead66e493d40878b85844bb413e1df; no voters:
I20260812 06:23:47.359977 2843 raft_consensus.cc:2781] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:47.360119 2843 raft_consensus.cc:686] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 LEADER]: Becoming Leader. State: Replica: a23714d8ae3b4097b66be67f6ba0e0f6, State: Running, Role: LEADER
I20260812 06:23:47.360193 2843 consensus_queue.cc:237] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } }
I20260812 06:23:47.360780 1647 catalog_manager.cc:5495] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67). New cstate: current_term: 1 leader_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a23714d8ae3b4097b66be67f6ba0e0f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43563 } health_report { overall_health: HEALTHY } } }
I20260812 06:23:47.368153 2872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:47.366118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58888 (local address 127.30.15.67:43563)
0812 06:23:47.366249 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:47.366251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:47.366257 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:23:47.366288 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:47.366289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:47.366304 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:47.366366 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:47.366451 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.366888 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.367555 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.367757 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.367802 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:47.367889 (+ 87us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:47.367987 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:47.368036 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:47.368070 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 06:23:47.368084 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
I20260812 06:23:47.372202 2866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:47.370194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:39227 (local address 127.30.15.66:38201)
0812 06:23:47.370226 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:47.370227 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:47.370270 (+ 43us) server_negotiation.cc:407] Connection header received
0812 06:23:47.370314 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:47.370315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:47.370323 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:47.370378 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:47.370487 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.370889 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.371676 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.371853 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.371897 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:47.372045 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:47.372068 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:47.372099 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:47.372146 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 06:23:47.372160 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 06:23:47.372229 2879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:47.370079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:38201 (local address 127.30.15.67:39227)
0812 06:23:47.370227 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:47.370235 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:47.370281 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:47.370390 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:47.370390 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:47.370391 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:23:47.370444 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:47.370445 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.370938 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.370938 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:47.371606 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:47.371608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.371917 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.371917 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:47.371971 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:47.371983 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:23:47.372115 (+ 132us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:23:47.372116 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:23:47.372145 (+ 29us) client_negotiation.cc:240] Negotiation successful
0812 06:23:47.372173 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260812 06:23:47.373777 1972 raft_consensus.cc:1261] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Refusing update from remote peer a23714d8ae3b4097b66be67f6ba0e0f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:47.373777 2239 raft_consensus.cc:1261] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Refusing update from remote peer a23714d8ae3b4097b66be67f6ba0e0f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:47.374027 2843 consensus_queue.cc:1035] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "daead66e493d40878b85844bb413e1df" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 38201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:47.374168 2868 consensus_queue.cc:1035] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2aa67117cf2421cac941b25f3f457da" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:47.380622 2872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:47.378466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:35561 (local address 127.30.15.67:43563)
0812 06:23:47.378551 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:47.378553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:47.378604 (+ 51us) server_negotiation.cc:407] Connection header received
0812 06:23:47.378652 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:47.378653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:47.378660 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:47.378697 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:47.378761 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.379165 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.380019 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.380300 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.380362 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:47.380480 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:47.380501 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:47.380529 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:47.380570 (+ 41us) server_negotiation.cc:299] Negotiation successful
0812 06:23:47.380581 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 06:23:47.380723 2885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:47.378435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:43563 (local address 127.30.15.66:35561)
0812 06:23:47.378556 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:47.378564 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:47.378615 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:47.378699 (+ 84us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:47.378699 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:47.378700 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:23:47.378731 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:47.378731 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.379246 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.379247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:47.379912 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:47.379915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:47.380359 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:47.380360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:47.380423 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:47.380427 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:23:47.380531 (+ 104us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:23:47.380532 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:23:47.380568 (+ 36us) client_negotiation.cc:240] Negotiation successful
0812 06:23:47.380611 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":89,"threads_started":1}
W20260812 06:23:47.381076 2777 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 06:23:48.903251 1649 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:48.903383 1649 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52612:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:48.904151 1649 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d54e7e38c2594ed08266d35913783ad9: Sending DeleteTablet for 3 replicas of tablet 703752f5c17b4674a6a66dd830246641
I20260812 06:23:48.904407 1941 tablet_service.cc:1514] Processing DeleteTablet for tablet 703752f5c17b4674a6a66dd830246641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:48 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:47546
I20260812 06:23:48.904443 2204 tablet_service.cc:1514] Processing DeleteTablet for tablet 703752f5c17b4674a6a66dd830246641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:48 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:54574
I20260812 06:23:48.904582 2479 tablet_service.cc:1514] Processing DeleteTablet for tablet 703752f5c17b4674a6a66dd830246641 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:48 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:58884
I20260812 06:23:48.904598 2930 tablet_replica.cc:330] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da: stopping tablet replica
I20260812 06:23:48.904660 2930 raft_consensus.cc:2229] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:48.904701 2930 raft_consensus.cc:2258] T 703752f5c17b4674a6a66dd830246641 P e2aa67117cf2421cac941b25f3f457da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:48.904762 2938 tablet_replica.cc:330] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6: stopping tablet replica
I20260812 06:23:48.904821 2938 raft_consensus.cc:2229] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:23:48.904873 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 1804
I20260812 06:23:48.904930 2938 raft_consensus.cc:2258] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:48.905604 2938 ts_tablet_manager.cc:1905] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:48.907238 2938 ts_tablet_manager.cc:1918] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:23:48.907341 2938 log.cc:1196] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/703752f5c17b4674a6a66dd830246641
I20260812 06:23:48.907538 2938 ts_tablet_manager.cc:1939] T 703752f5c17b4674a6a66dd830246641 P a23714d8ae3b4097b66be67f6ba0e0f6: Deleting consensus metadata
I20260812 06:23:48.910035 1622 catalog_manager.cc:4841] TS a23714d8ae3b4097b66be67f6ba0e0f6 (127.30.15.67:43563): tablet 703752f5c17b4674a6a66dd830246641 (table test-table [id=04397f73be124b7184332997172dbfc2]) successfully deleted
I20260812 06:23:48.915405 2931 tablet_replica.cc:330] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df: stopping tablet replica
I20260812 06:23:48.915477 2931 raft_consensus.cc:2229] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:48.915524 2931 raft_consensus.cc:2258] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:48.915776 2931 ts_tablet_manager.cc:1905] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:48.917385 2931 ts_tablet_manager.cc:1918] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 06:23:48.917447 2931 log.cc:1196] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/703752f5c17b4674a6a66dd830246641
I20260812 06:23:48.917642 2931 ts_tablet_manager.cc:1939] T 703752f5c17b4674a6a66dd830246641 P daead66e493d40878b85844bb413e1df: Deleting consensus metadata
I20260812 06:23:48.918103 1621 catalog_manager.cc:4841] TS daead66e493d40878b85844bb413e1df (127.30.15.66:38201): tablet 703752f5c17b4674a6a66dd830246641 (table test-table [id=04397f73be124b7184332997172dbfc2]) successfully deleted
W20260812 06:23:48.920223 1621 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:42869 (error 108)
I20260812 06:23:48.920504 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 2072
I20260812 06:23:48.927367 2941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:48.920558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:42869 (local address 127.0.0.1:47578)
0812 06:23:48.927244 (+ 6686us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:48.927326 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:42869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6662,"thread_start_us":77,"threads_started":1}
W20260812 06:23:48.927500 1621 catalog_manager.cc:4584] TS e2aa67117cf2421cac941b25f3f457da (127.30.15.65:42869): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 703752f5c17b4674a6a66dd830246641: Network error: Client connection negotiation failed: client connection to 127.30.15.65:42869: connect: Connection refused (error 111)
I20260812 06:23:48.940706 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 2349
I20260812 06:23:48.955533 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 1579
2026-08-12T06:23:48Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5807 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:23:49 dist-test-slave-gjrz krb5kdc[2946](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:23:49 dist-test-slave-gjrz krb5kdc[2946](info): set up 2 sockets
Aug 12 06:23:49 dist-test-slave-gjrz krb5kdc[2946](info): commencing operation
krb5kdc: starting...
W20260812 06:23:50.153395 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:23:50 dist-test-slave-gjrz krb5kdc[2946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:23:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:23:50.263778 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:41859
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:39563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:41859
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:50.341745 2972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:50.341960 2972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:50.341991 2972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:50.343093 2972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:50.343133 2972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:50.343153 2972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:50.343168 2972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:50.343184 2972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:23:50.344658 2972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:41859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:41859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:50.344893 2972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:50.345105 2972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:50.349740 2986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:50.349776 2972 server_base.cc:1034] running on GCE node
W20260812 06:23:50.349736 2982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:50.349745 2984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:50.350286 2972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:50.350561 2972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:50.351696 2972 hybrid_clock.cc:648] HybridClock initialized: now 1786515830351679 us; error 27 us; skew 500 ppm
Aug 12 06:23:50 dist-test-slave-gjrz krb5kdc[2946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515830, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:50.353956 2972 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:23:50.354346 2972 webserver.cc:460] Webserver started at http://127.30.15.126:38373/ using document root <none> and password file <none>
I20260812 06:23:50.354530 2972 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:50.354570 2972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:50.354710 2972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:50.355702 2972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "79a14505b37a41dea7af1ea1642db30c"
format_stamp: "Formatted at 2026-08-12 06:23:50 on dist-test-slave-gjrz"
server_key: "66c92451a2dabff5dbc6882d816ca8eb"
server_key_iv: "fbe7971c2e4859a1c9325d5ff1251d12"
server_key_version: "encryptionkey@0"
I20260812 06:23:50.355994 2972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "79a14505b37a41dea7af1ea1642db30c"
format_stamp: "Formatted at 2026-08-12 06:23:50 on dist-test-slave-gjrz"
server_key: "66c92451a2dabff5dbc6882d816ca8eb"
server_key_iv: "fbe7971c2e4859a1c9325d5ff1251d12"
server_key_version: "encryptionkey@0"
I20260812 06:23:50.357137 2972 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:23:50.357800 2999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:50.357954 2972 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:50.358033 2972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "79a14505b37a41dea7af1ea1642db30c"
format_stamp: "Formatted at 2026-08-12 06:23:50 on dist-test-slave-gjrz"
server_key: "66c92451a2dabff5dbc6882d816ca8eb"
server_key_iv: "fbe7971c2e4859a1c9325d5ff1251d12"
server_key_version: "encryptionkey@0"
I20260812 06:23:50.358093 2972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:50.370723 2972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:50.372336 2972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:50.372459 2972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:50.376192 2972 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:41859
I20260812 06:23:50.376235 3104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:41859 every 8 connection(s)
I20260812 06:23:50.376521 2972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:50.377365 3105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:50.377555 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 2972
I20260812 06:23:50.377636 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:50.377789 30781 external_mini_cluster.cc:1428] Setting key 4ce30e7b88f095dff1eca207ab4682c1
I20260812 06:23:50.380617 3105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c: Bootstrap starting.
I20260812 06:23:50.381273 3105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:50.381556 3105 log.cc:824] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:50.382253 3105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c: No bootstrap required, opened a new log
Aug 12 06:23:50 dist-test-slave-gjrz krb5kdc[2946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:50.384261 3105 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79a14505b37a41dea7af1ea1642db30c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41859 } }
I20260812 06:23:50.384390 3105 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:50.384424 3105 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79a14505b37a41dea7af1ea1642db30c, State: Initialized, Role: FOLLOWER
I20260812 06:23:50.384574 3105 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79a14505b37a41dea7af1ea1642db30c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41859 } }
I20260812 06:23:50.384662 3105 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:50.384703 3105 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:50.384752 3105 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:50.385368 3105 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79a14505b37a41dea7af1ea1642db30c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41859 } }
I20260812 06:23:50.385489 3105 leader_election.cc:302] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79a14505b37a41dea7af1ea1642db30c; no voters:
I20260812 06:23:50.385663 3105 leader_election.cc:288] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:50.385708 3117 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:50.385890 3117 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [term 1 LEADER]: Becoming Leader. State: Replica: 79a14505b37a41dea7af1ea1642db30c, State: Running, Role: LEADER
I20260812 06:23:50.385907 3105 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:50.386032 3117 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79a14505b37a41dea7af1ea1642db30c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41859 } }
I20260812 06:23:50.386415 3120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79a14505b37a41dea7af1ea1642db30c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79a14505b37a41dea7af1ea1642db30c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41859 } } }
I20260812 06:23:50.386432 3121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79a14505b37a41dea7af1ea1642db30c. Latest consensus state: current_term: 1 leader_uuid: "79a14505b37a41dea7af1ea1642db30c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79a14505b37a41dea7af1ea1642db30c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41859 } } }
I20260812 06:23:50.386502 3120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:50.386528 3121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:50.387702 3126 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:50.388212 3113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:50.378220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42536 (local address 127.30.15.126:41859)
0812 06:23:50.378399 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:50.378407 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:50.378444 (+ 37us) server_negotiation.cc:407] Connection header received
0812 06:23:50.378855 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:50.378864 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:50.378926 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:50.379079 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:50.379648 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.380988 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.381744 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.382274 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.382394 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:50.384455 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:50.384459 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:50.384459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:50.384470 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:50.386395 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:50.386804 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:50.386807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:50.386808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:50.386915 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:50.387156 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:50.387157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:50.387157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:50.387489 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:50.387674 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:50.387980 (+ 306us) server_negotiation.cc:299] Negotiation successful
0812 06:23:50.388079 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":82,"threads_started":1}
I20260812 06:23:50.388249 3126 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:50.389623 3126 catalog_manager.cc:1347] Generated new cluster ID: 3fba2d28dcfc4c58a8c0df93586fe4c1
I20260812 06:23:50.389678 3126 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:23:50.399075 3126 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:50.399778 3126 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:50.408586 3126 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79a14505b37a41dea7af1ea1642db30c: Generated new TSK 0
I20260812 06:23:50.408739 3126 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:23:50.435854 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41859
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:39563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:50.515563 3159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:50.515740 3159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:50.515761 3159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:50.516829 3159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:50.516861 3159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:50.516885 3159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:23:50.518236 3159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:50.518401 3159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:50.518565 3159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:50.523132 3166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:50.523130 3170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:50.523222 3159 server_base.cc:1034] running on GCE node
W20260812 06:23:50.523185 3168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:50.523535 3159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:50.523758 3159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:50.524893 3159 hybrid_clock.cc:648] HybridClock initialized: now 1786515830524879 us; error 27 us; skew 500 ppm
Aug 12 06:23:50 dist-test-slave-gjrz krb5kdc[2946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515830, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:50.528007 3159 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:23:50.528488 3159 webserver.cc:460] Webserver started at http://127.30.15.65:44059/ using document root <none> and password file <none>
I20260812 06:23:50.528697 3159 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:50.528743 3159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:50.528869 3159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:50.530031 3159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "1847e907f1f74b72a342ddea584f3cf8"
format_stamp: "Formatted at 2026-08-12 06:23:50 on dist-test-slave-gjrz"
server_key: "65ea4521b0e80ef729eda47304b861a9"
server_key_iv: "78e2614ec6df208d31c51fef424459f7"
server_key_version: "encryptionkey@0"
I20260812 06:23:50.530481 3159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "1847e907f1f74b72a342ddea584f3cf8"
format_stamp: "Formatted at 2026-08-12 06:23:50 on dist-test-slave-gjrz"
server_key: "65ea4521b0e80ef729eda47304b861a9"
server_key_iv: "78e2614ec6df208d31c51fef424459f7"
server_key_version: "encryptionkey@0"
I20260812 06:23:50.532205 3159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:23:50.535408 3180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:50.535565 3159 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260812 06:23:50.535656 3159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "1847e907f1f74b72a342ddea584f3cf8"
format_stamp: "Formatted at 2026-08-12 06:23:50 on dist-test-slave-gjrz"
server_key: "65ea4521b0e80ef729eda47304b861a9"
server_key_iv: "78e2614ec6df208d31c51fef424459f7"
server_key_version: "encryptionkey@0"
I20260812 06:23:50.535722 3159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:50.559022 3159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:50.561410 3159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:50.561550 3159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:50.561759 3159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:50.562100 3159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:50.562144 3159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:50.562178 3159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:50.562196 3159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:50.568296 3159 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:35633
I20260812 06:23:50.568387 3385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:35633 every 8 connection(s)
I20260812 06:23:50.568645 3159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:23:50.570042 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 3159
I20260812 06:23:50.570139 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:23:50.570304 30781 external_mini_cluster.cc:1428] Setting key 4fc06f0b9ac224dd03c78e592e924b83
Aug 12 06:23:50 dist-test-slave-gjrz krb5kdc[2946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515830, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:50.579788 3113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:50.569330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:41641 (local address 127.30.15.126:41859)
0812 06:23:50.569374 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:50.569377 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:50.569654 (+ 277us) server_negotiation.cc:407] Connection header received
0812 06:23:50.570334 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:50.570336 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:50.570350 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:50.570381 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:50.571762 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.572556 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.573991 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.574203 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.574258 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:50.576674 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:50.576676 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:50.576676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:50.576684 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:50.578237 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:50.578690 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:50.578691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:50.578692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:50.578758 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:50.579033 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:50.579034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:50.579034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:50.579175 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:50.579251 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:50.579593 (+ 342us) server_negotiation.cc:299] Negotiation successful
0812 06:23:50.579688 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:23:50.579912 3393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:50.569323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41859 (local address 127.30.15.65:41641)
0812 06:23:50.569512 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:50.569560 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:50.570198 (+ 638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:50.570579 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:50.570583 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:50.571342 (+ 759us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:50.571641 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:50.571649 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.572680 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.572681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:50.573903 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:50.573907 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.574286 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.574287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:50.574422 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:50.574855 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:50.574866 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:50.576585 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:50.578321 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:50.578329 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:50.578331 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:50.578609 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:50.578825 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:50.578825 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:50.578826 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:50.578971 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:50.579253 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:50.579281 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:50.579441 (+ 160us) client_negotiation.cc:769] Sending connection context
0812 06:23:50.579552 (+ 111us) client_negotiation.cc:240] Negotiation successful
0812 06:23:50.579706 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":100,"threads_started":1}
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
I20260812 06:23:50.580559 3387 heartbeater.cc:347] Connected to a master server at 127.30.15.126:41859
I20260812 06:23:50.580654 3387 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:50.580821 3387 heartbeater.cc:511] Master 127.30.15.126:41859 requested a full tablet report, sending...
I20260812 06:23:50.581322 3043 ts_manager.cc:194] Registered new tserver with Master: 1847e907f1f74b72a342ddea584f3cf8 (127.30.15.65:35633)
I20260812 06:23:50.581918 3043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:41641
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:23:50.596232 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41859
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:39563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:50.675077 3397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:50.675257 3397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:50.675312 3397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:50.676426 3397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:50.676465 3397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:50.676491 3397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:23:50.677840 3397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:50.678020 3397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:50.678185 3397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:50.682931 3405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:50.682945 3411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:50.683017 3404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:50.683238 3397 server_base.cc:1034] running on GCE node
I20260812 06:23:50.683506 3397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:50.683727 3397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:50.684860 3397 hybrid_clock.cc:648] HybridClock initialized: now 1786515830684847 us; error 31 us; skew 500 ppm
Aug 12 06:23:50 dist-test-slave-gjrz krb5kdc[2946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515830, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:50.687378 3397 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:23:50.687790 3397 webserver.cc:460] Webserver started at http://127.30.15.66:41303/ using document root <none> and password file <none>
I20260812 06:23:50.688042 3397 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:50.688099 3397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:50.688233 3397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:50.689215 3397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "dfaf28739d2b47888b1af9a469c56bd3"
format_stamp: "Formatted at 2026-08-12 06:23:50 on dist-test-slave-gjrz"
server_key: "4528bc99952c3a66b2a84b10370d5023"
server_key_iv: "ad0a36394b337c490e147bec6a551f1c"
server_key_version: "encryptionkey@0"
I20260812 06:23:50.689531 3397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "dfaf28739d2b47888b1af9a469c56bd3"
format_stamp: "Formatted at 2026-08-12 06:23:50 on dist-test-slave-gjrz"
server_key: "4528bc99952c3a66b2a84b10370d5023"
server_key_iv: "ad0a36394b337c490e147bec6a551f1c"
server_key_version: "encryptionkey@0"
I20260812 06:23:50.690719 3397 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:23:50.691437 3427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:50.691570 3397 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:50.691644 3397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "dfaf28739d2b47888b1af9a469c56bd3"
format_stamp: "Formatted at 2026-08-12 06:23:50 on dist-test-slave-gjrz"
server_key: "4528bc99952c3a66b2a84b10370d5023"
server_key_iv: "ad0a36394b337c490e147bec6a551f1c"
server_key_version: "encryptionkey@0"
I20260812 06:23:50.691708 3397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:50.711769 3397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:50.713686 3397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:50.713796 3397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:50.714005 3397 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:50.714280 3397 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:50.714313 3397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:50.714334 3397 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:50.714356 3397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:50.719936 3397 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:45209
I20260812 06:23:50.720007 3678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:45209 every 8 connection(s)
I20260812 06:23:50.720266 3397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:23:50 dist-test-slave-gjrz krb5kdc[2946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515830, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:50.728425 3113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:50.720936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:35311 (local address 127.30.15.126:41859)
0812 06:23:50.720987 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:50.720989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:50.721159 (+ 170us) server_negotiation.cc:407] Connection header received
0812 06:23:50.721613 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:50.721614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:50.721623 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:50.721657 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:50.722523 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.723002 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.723962 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.724155 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.724201 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:50.725967 (+ 1766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:50.725969 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:50.725969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:50.725977 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:50.727152 (+ 1175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:50.727573 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:50.727574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:50.727575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:50.727625 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:50.727890 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:50.727890 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:50.727891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:50.727990 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:50.728033 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:50.728291 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 06:23:50.728361 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:23:50.728520 3682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:50.720895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41859 (local address 127.30.15.66:35311)
0812 06:23:50.721046 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:50.721084 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:50.721525 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:50.721714 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:50.721717 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:50.722270 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:50.722451 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:50.722456 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.723063 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.723063 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:50.723885 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:50.723889 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.724207 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.724208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:50.724307 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:50.724659 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:50.724666 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:50.725886 (+ 1220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:50.727241 (+ 1355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:50.727248 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:50.727249 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:50.727511 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:50.727708 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:50.727709 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:50.727709 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:50.727830 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:50.728034 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:50.728037 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:50.728142 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 06:23:50.728232 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 06:23:50.728351 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260812 06:23:50.729069 3679 heartbeater.cc:347] Connected to a master server at 127.30.15.126:41859
I20260812 06:23:50.729157 3679 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:50.729324 3679 heartbeater.cc:511] Master 127.30.15.126:41859 requested a full tablet report, sending...
I20260812 06:23:50.729671 3043 ts_manager.cc:194] Registered new tserver with Master: dfaf28739d2b47888b1af9a469c56bd3 (127.30.15.66:45209)
I20260812 06:23:50.730039 3043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:35311
I20260812 06:23:50.730499 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 3397
I20260812 06:23:50.730605 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:23:50.730794 30781 external_mini_cluster.cc:1428] Setting key 6f0296b3bf06104c9882613a1d277a09
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:23:50.754087 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41859
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:39563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:50.832574 3690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:50.832748 3690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:50.832770 3690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:50.833859 3690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:50.833896 3690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:50.833920 3690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:23:50.835253 3690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41859
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:50.835438 3690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:50.835595 3690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:50.840365 3703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:50.840359 3699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:50.840359 3698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:50.840633 3690 server_base.cc:1034] running on GCE node
I20260812 06:23:50.840842 3690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:50.841076 3690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:50.842231 3690 hybrid_clock.cc:648] HybridClock initialized: now 1786515830842219 us; error 27 us; skew 500 ppm
Aug 12 06:23:50 dist-test-slave-gjrz krb5kdc[2946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515830, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:50.844686 3690 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:23:50.845069 3690 webserver.cc:460] Webserver started at http://127.30.15.67:44139/ using document root <none> and password file <none>
I20260812 06:23:50.845228 3690 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:50.845265 3690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:50.845350 3690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:50.846314 3690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "8518cc0414904990a0fa5f0e11efd50b"
format_stamp: "Formatted at 2026-08-12 06:23:50 on dist-test-slave-gjrz"
server_key: "270948aa2716e9d00335c760caa32d23"
server_key_iv: "076908d5fe2c4a606e90a9c29ba94085"
server_key_version: "encryptionkey@0"
I20260812 06:23:50.846602 3690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "8518cc0414904990a0fa5f0e11efd50b"
format_stamp: "Formatted at 2026-08-12 06:23:50 on dist-test-slave-gjrz"
server_key: "270948aa2716e9d00335c760caa32d23"
server_key_iv: "076908d5fe2c4a606e90a9c29ba94085"
server_key_version: "encryptionkey@0"
I20260812 06:23:50.848001 3690 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:23:50.848613 3718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:50.848760 3690 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:50.848838 3690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "8518cc0414904990a0fa5f0e11efd50b"
format_stamp: "Formatted at 2026-08-12 06:23:50 on dist-test-slave-gjrz"
server_key: "270948aa2716e9d00335c760caa32d23"
server_key_iv: "076908d5fe2c4a606e90a9c29ba94085"
server_key_version: "encryptionkey@0"
I20260812 06:23:50.848891 3690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:50.884806 3690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:50.886574 3690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:50.886698 3690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:50.886911 3690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:50.887202 3690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:50.887234 3690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:50.887253 3690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:50.887296 3690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:50.893289 3690 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:39305
I20260812 06:23:50.893345 3940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:39305 every 8 connection(s)
I20260812 06:23:50.893617 3690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:23:50.898500 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 3690
I20260812 06:23:50.898586 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:23:50.898746 30781 external_mini_cluster.cc:1428] Setting key 0d2362800d3cc3fa291fed4ae0890709
Aug 12 06:23:50 dist-test-slave-gjrz krb5kdc[2946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515830, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:50.901918 3113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:50.894311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:33099 (local address 127.30.15.126:41859)
0812 06:23:50.894384 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:50.894386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:50.894534 (+ 148us) server_negotiation.cc:407] Connection header received
0812 06:23:50.894973 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:50.894974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:50.894983 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:50.895051 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:50.895955 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.896447 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.897354 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.897539 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.897586 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:50.899716 (+ 2130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:50.899717 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:50.899717 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:50.899724 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:50.900708 (+ 984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:50.901058 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:50.901060 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:50.901060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:50.901112 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:50.901324 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:50.901324 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:50.901325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:50.901430 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:50.901486 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:50.901737 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 06:23:50.901814 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 06:23:50.902072 3945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:50.894250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41859 (local address 127.30.15.67:33099)
0812 06:23:50.894405 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:50.894442 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:50.894905 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:50.895107 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:50.895110 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:50.895708 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:50.895886 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:50.895891 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.896509 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.896509 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:50.897292 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:50.897294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:50.897595 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:50.897596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:50.897685 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:50.898109 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:50.898117 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:50.899639 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:50.900779 (+ 1140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:50.900786 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:50.900788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:50.900989 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:50.901166 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:50.901167 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:50.901168 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:50.901269 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:50.901484 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:50.901492 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:50.901624 (+ 132us) client_negotiation.cc:769] Sending connection context
0812 06:23:50.901709 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:23:50.901855 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260812 06:23:50.902485 3941 heartbeater.cc:347] Connected to a master server at 127.30.15.126:41859
I20260812 06:23:50.902572 3941 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:50.902734 3941 heartbeater.cc:511] Master 127.30.15.126:41859 requested a full tablet report, sending...
I20260812 06:23:50.903066 3043 ts_manager.cc:194] Registered new tserver with Master: 8518cc0414904990a0fa5f0e11efd50b (127.30.15.67:39305)
I20260812 06:23:50.903458 3043 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:33099
I20260812 06:23:50.910233 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 06:23:50.921167 3113 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:23:50.920437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42548 (local address 127.30.15.126:41859)
0812 06:23:50.920494 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:50.920496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:50.920577 (+ 81us) server_negotiation.cc:407] Connection header received
0812 06:23:50.920624 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:50.920625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:50.920632 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:50.920676 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:50.921109 (+ 433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42548: BlockingRecv error: recv got EOF from 127.0.0.1:42548 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:23:50.922008 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 3159
I20260812 06:23:50.949855 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 3397
I20260812 06:23:50.960801 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 3690
I20260812 06:23:50.967218 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 2972
2026-08-12T06:23:50Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2012 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:23:51 dist-test-slave-gjrz krb5kdc[3963](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:23:51 dist-test-slave-gjrz krb5kdc[3963](info): set up 2 sockets
Aug 12 06:23:51 dist-test-slave-gjrz krb5kdc[3963](info): commencing operation
krb5kdc: starting...
W20260812 06:23:52.158217 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:23:52 dist-test-slave-gjrz krb5kdc[3963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:23:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:23:52.267793 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:44235
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:35419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:44235
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:52.345752 3987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:52.345928 3987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:52.345957 3987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:52.347060 3987 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:52.347101 3987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:52.347119 3987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:52.347136 3987 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:52.347150 3987 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:23:52.348595 3987 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:35419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:44235
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:44235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:52.348811 3987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:52.349011 3987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:52.353457 3999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:52.353492 4000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:52.353466 4006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:52.353504 3987 server_base.cc:1034] running on GCE node
I20260812 06:23:52.353916 3987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:52.354182 3987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:52.355333 3987 hybrid_clock.cc:648] HybridClock initialized: now 1786515832355313 us; error 28 us; skew 500 ppm
Aug 12 06:23:52 dist-test-slave-gjrz krb5kdc[3963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515832, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:52.360989 3987 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:23:52.361380 3987 webserver.cc:460] Webserver started at http://127.30.15.126:42581/ using document root <none> and password file <none>
I20260812 06:23:52.361594 3987 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:52.361640 3987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:52.361758 3987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:52.362713 3987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "9eb3fdd8df024292b686b719527de9e9"
format_stamp: "Formatted at 2026-08-12 06:23:52 on dist-test-slave-gjrz"
server_key: "e64b91645bf10f48337edb35d561c09d"
server_key_iv: "5c8846a3fae40d1f4eaa678de4bf50e7"
server_key_version: "encryptionkey@0"
I20260812 06:23:52.363024 3987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "9eb3fdd8df024292b686b719527de9e9"
format_stamp: "Formatted at 2026-08-12 06:23:52 on dist-test-slave-gjrz"
server_key: "e64b91645bf10f48337edb35d561c09d"
server_key_iv: "5c8846a3fae40d1f4eaa678de4bf50e7"
server_key_version: "encryptionkey@0"
I20260812 06:23:52.364243 3987 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:23:52.364902 4019 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:52.365047 3987 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:52.365126 3987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "9eb3fdd8df024292b686b719527de9e9"
format_stamp: "Formatted at 2026-08-12 06:23:52 on dist-test-slave-gjrz"
server_key: "e64b91645bf10f48337edb35d561c09d"
server_key_iv: "5c8846a3fae40d1f4eaa678de4bf50e7"
server_key_version: "encryptionkey@0"
I20260812 06:23:52.365190 3987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:52.376789 3987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:52.378636 3987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:52.378758 3987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:52.382567 3987 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:44235
I20260812 06:23:52.382601 4120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:44235 every 8 connection(s)
I20260812 06:23:52.382994 3987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:52.383639 4122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:52.385829 4122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9: Bootstrap starting.
I20260812 06:23:52.386365 4122 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:52.386608 4122 log.cc:824] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:52.387228 4122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9: No bootstrap required, opened a new log
I20260812 06:23:52.388737 4122 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fdd8df024292b686b719527de9e9" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44235 } }
I20260812 06:23:52.388862 4122 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:52.388892 4122 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eb3fdd8df024292b686b719527de9e9, State: Initialized, Role: FOLLOWER
I20260812 06:23:52.388999 4122 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fdd8df024292b686b719527de9e9" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44235 } }
I20260812 06:23:52.389052 4122 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:52.389081 4122 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:52.389118 4122 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:52.389937 4122 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fdd8df024292b686b719527de9e9" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44235 } }
I20260812 06:23:52.390034 4122 leader_election.cc:302] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9eb3fdd8df024292b686b719527de9e9; no voters:
I20260812 06:23:52.390174 4122 leader_election.cc:288] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:52.390234 4128 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:52.390383 4128 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [term 1 LEADER]: Becoming Leader. State: Replica: 9eb3fdd8df024292b686b719527de9e9, State: Running, Role: LEADER
I20260812 06:23:52.390406 4122 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:52.390468 4128 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fdd8df024292b686b719527de9e9" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44235 } }
I20260812 06:23:52.390825 4132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eb3fdd8df024292b686b719527de9e9. Latest consensus state: current_term: 1 leader_uuid: "9eb3fdd8df024292b686b719527de9e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fdd8df024292b686b719527de9e9" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44235 } } }
I20260812 06:23:52.390837 4131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9eb3fdd8df024292b686b719527de9e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eb3fdd8df024292b686b719527de9e9" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44235 } } }
I20260812 06:23:52.390914 4132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:52.390935 4131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:52.391641 4145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:52.391669 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 3987
I20260812 06:23:52.391755 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:52.391908 30781 external_mini_cluster.cc:1428] Setting key cc61bb4e71db25621954f11fff4beab7
I20260812 06:23:52.392133 4145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:52.393769 4145 catalog_manager.cc:1347] Generated new cluster ID: 1526b956f6684f598d9b8b818f532f8b
I20260812 06:23:52.393812 4145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:23:52 dist-test-slave-gjrz krb5kdc[3963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:52.403081 4161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:52.392461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44898 (local address 127.30.15.126:44235)
0812 06:23:52.392616 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:52.392623 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:52.392646 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:23:52.392844 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:52.392849 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:52.392894 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:52.393032 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:52.393938 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:52.395358 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:52.396427 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:52.397038 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:52.397126 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:52.399746 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:52.399750 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:52.399751 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:52.399762 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:52.401548 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:52.401921 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:52.401924 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:52.401924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:52.402023 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:52.402241 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:52.402241 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:52.402241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:52.402510 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:52.402645 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:52.402749 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 06:23:52.402874 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":105,"thread_start_us":78,"threads_started":1}
I20260812 06:23:52.403914 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:23:52.414542 4145 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:52.415028 4145 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:52.424695 4161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:52.420814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44912 (local address 127.30.15.126:44235)
0812 06:23:52.420847 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:52.420849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:52.421011 (+ 162us) server_negotiation.cc:407] Connection header received
0812 06:23:52.421031 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:52.421031 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:52.421040 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:52.421098 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:52.421534 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:52.422254 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:52.423304 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:52.423604 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:52.423656 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:52.424269 (+ 613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:52.424270 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:52.424271 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:52.424468 (+ 197us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:52.424484 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:52.424490 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:52.424538 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:52.424607 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 06:23:52.424628 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:23:52.428416 4145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9eb3fdd8df024292b686b719527de9e9: Generated new TSK 0
I20260812 06:23:52.428592 4145 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:23:52.432425 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 3987
2026-08-12T06:23:52Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1473 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:23:52 dist-test-slave-gjrz krb5kdc[4182](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:23:52 dist-test-slave-gjrz krb5kdc[4182](info): set up 2 sockets
Aug 12 06:23:52 dist-test-slave-gjrz krb5kdc[4182](info): commencing operation
krb5kdc: starting...
W20260812 06:23:53.633870 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:23:53 dist-test-slave-gjrz krb5kdc[4182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:23:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:23:53.744194 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:44649
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:45369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:44649
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:53.822413 4211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:53.822621 4211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:53.822650 4211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:53.823789 4211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:53.823827 4211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:53.823846 4211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:53.823863 4211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:53.823879 4211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:23:53.825314 4211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:45369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:44649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:44649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:53.825546 4211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:53.825743 4211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:53.830222 4225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:53.830294 4226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:53.830217 4229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:53.830353 4211 server_base.cc:1034] running on GCE node
I20260812 06:23:53.830592 4211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:53.830863 4211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:53.832000 4211 hybrid_clock.cc:648] HybridClock initialized: now 1786515833831984 us; error 32 us; skew 500 ppm
Aug 12 06:23:53 dist-test-slave-gjrz krb5kdc[4182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515833, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:53.834272 4211 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:23:53.834659 4211 webserver.cc:460] Webserver started at http://127.30.15.126:41435/ using document root <none> and password file <none>
I20260812 06:23:53.834863 4211 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:53.834908 4211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:53.835031 4211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:53.836074 4211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "adc2add9a5ec4a6689e59f5647565155"
format_stamp: "Formatted at 2026-08-12 06:23:53 on dist-test-slave-gjrz"
server_key: "05e1da36f8626d4803ee51b677210081"
server_key_iv: "06047091dedf286b978d32d889206e96"
server_key_version: "encryptionkey@0"
I20260812 06:23:53.836404 4211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "adc2add9a5ec4a6689e59f5647565155"
format_stamp: "Formatted at 2026-08-12 06:23:53 on dist-test-slave-gjrz"
server_key: "05e1da36f8626d4803ee51b677210081"
server_key_iv: "06047091dedf286b978d32d889206e96"
server_key_version: "encryptionkey@0"
I20260812 06:23:53.837639 4211 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:23:53.838349 4245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:53.838498 4211 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:53.838577 4211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "adc2add9a5ec4a6689e59f5647565155"
format_stamp: "Formatted at 2026-08-12 06:23:53 on dist-test-slave-gjrz"
server_key: "05e1da36f8626d4803ee51b677210081"
server_key_iv: "06047091dedf286b978d32d889206e96"
server_key_version: "encryptionkey@0"
I20260812 06:23:53.838644 4211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:53.848136 4211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:53.850232 4211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:53.850355 4211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:53.854059 4211 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:44649
I20260812 06:23:53.854103 4345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:44649 every 8 connection(s)
I20260812 06:23:53.854383 4211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:53.855319 4348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:53.857384 4348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155: Bootstrap starting.
I20260812 06:23:53.857908 4348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:53.858070 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 4211
I20260812 06:23:53.858170 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:53.858254 4348 log.cc:824] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:53.858345 30781 external_mini_cluster.cc:1428] Setting key 2fcbf01cd248476229c47b9c5d0b2aab
I20260812 06:23:53.859038 4348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155: No bootstrap required, opened a new log
I20260812 06:23:53.861258 4348 raft_consensus.cc:348] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adc2add9a5ec4a6689e59f5647565155" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44649 } }
I20260812 06:23:53.861416 4348 raft_consensus.cc:374] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:53.861449 4348 raft_consensus.cc:729] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adc2add9a5ec4a6689e59f5647565155, State: Initialized, Role: FOLLOWER
I20260812 06:23:53.861573 4348 consensus_queue.cc:260] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adc2add9a5ec4a6689e59f5647565155" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44649 } }
I20260812 06:23:53.861668 4348 raft_consensus.cc:388] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:53.861704 4348 raft_consensus.cc:482] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:53.861747 4348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:53.862365 4348 raft_consensus.cc:504] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adc2add9a5ec4a6689e59f5647565155" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44649 } }
I20260812 06:23:53.862449 4348 leader_election.cc:302] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: adc2add9a5ec4a6689e59f5647565155; no voters:
I20260812 06:23:53.862596 4348 leader_election.cc:288] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:53.862629 4355 raft_consensus.cc:2781] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:53.862767 4355 raft_consensus.cc:686] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [term 1 LEADER]: Becoming Leader. State: Replica: adc2add9a5ec4a6689e59f5647565155, State: Running, Role: LEADER
I20260812 06:23:53.862846 4348 sys_catalog.cc:564] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:53.862888 4355 consensus_queue.cc:237] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adc2add9a5ec4a6689e59f5647565155" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44649 } }
I20260812 06:23:53.863258 4355 sys_catalog.cc:455] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "adc2add9a5ec4a6689e59f5647565155" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adc2add9a5ec4a6689e59f5647565155" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44649 } } }
I20260812 06:23:53.863413 4355 sys_catalog.cc:458] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:53.863583 4355 sys_catalog.cc:455] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [sys.catalog]: SysCatalogTable state changed. Reason: New leader adc2add9a5ec4a6689e59f5647565155. Latest consensus state: current_term: 1 leader_uuid: "adc2add9a5ec4a6689e59f5647565155" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adc2add9a5ec4a6689e59f5647565155" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44649 } } }
I20260812 06:23:53.863692 4355 sys_catalog.cc:458] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:53.863983 4367 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:53.864451 4367 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 06:23:53 dist-test-slave-gjrz krb5kdc[4182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:53.866070 4367 catalog_manager.cc:1347] Generated new cluster ID: 6d877383eb784ef0a19a0ccbc0cf3bc3
I20260812 06:23:53.866118 4367 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:23:53.868782 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:53.858789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60730 (local address 127.30.15.126:44649)
0812 06:23:53.858940 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:53.858949 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:53.858976 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:23:53.859449 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:53.859456 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:53.859503 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:53.859609 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:53.860333 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:53.861185 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:53.862218 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:53.862683 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:53.862787 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:53.865317 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:53.865321 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:53.865322 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:53.865333 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:53.867219 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:53.867632 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:53.867635 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:53.867635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:53.867749 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:53.867923 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:53.867923 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:53.867924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:53.868222 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:53.868382 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:53.868450 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 06:23:53.868581 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":68,"threads_started":1}
I20260812 06:23:53.871039 4367 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:53.871555 4367 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:53.875411 4367 catalog_manager.cc:5868] T 00000000000000000000000000000000 P adc2add9a5ec4a6689e59f5647565155: Generated new TSK 0
I20260812 06:23:53.875583 4367 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:23:53.903237 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44649
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:45369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:53.982101 4393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:53.982287 4393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:53.982317 4393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:53.983461 4393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:53.983506 4393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:53.983541 4393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:23:53.985000 4393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:45369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:53.985224 4393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:53.985419 4393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:53.990144 4399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:53.990247 4393 server_base.cc:1034] running on GCE node
W20260812 06:23:53.990144 4408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:53.990144 4398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:53.990561 4393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:53.990783 4393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:53.991919 4393 hybrid_clock.cc:648] HybridClock initialized: now 1786515833991906 us; error 28 us; skew 500 ppm
Aug 12 06:23:53 dist-test-slave-gjrz krb5kdc[4182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515833, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:53.994203 4393 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:23:53.994585 4393 webserver.cc:460] Webserver started at http://127.30.15.65:38359/ using document root <none> and password file <none>
I20260812 06:23:53.994779 4393 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:53.994825 4393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:53.994954 4393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:53.995942 4393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "890aff7bbb774710bb089c5442ee8718"
format_stamp: "Formatted at 2026-08-12 06:23:53 on dist-test-slave-gjrz"
server_key: "ff34585c30dc14b67da72e6a2143f324"
server_key_iv: "a279ab25bc109a52fdb490989c520f36"
server_key_version: "encryptionkey@0"
I20260812 06:23:53.996263 4393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "890aff7bbb774710bb089c5442ee8718"
format_stamp: "Formatted at 2026-08-12 06:23:53 on dist-test-slave-gjrz"
server_key: "ff34585c30dc14b67da72e6a2143f324"
server_key_iv: "a279ab25bc109a52fdb490989c520f36"
server_key_version: "encryptionkey@0"
I20260812 06:23:53.997488 4393 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:23:53.998193 4424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:53.998363 4393 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:53.998445 4393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "890aff7bbb774710bb089c5442ee8718"
format_stamp: "Formatted at 2026-08-12 06:23:53 on dist-test-slave-gjrz"
server_key: "ff34585c30dc14b67da72e6a2143f324"
server_key_iv: "a279ab25bc109a52fdb490989c520f36"
server_key_version: "encryptionkey@0"
I20260812 06:23:53.998503 4393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:54.008320 4393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:54.009981 4393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:54.010110 4393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:54.010296 4393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:54.010560 4393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:54.010591 4393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:54.010618 4393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:54.010634 4393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:54.016307 4393 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:45325
I20260812 06:23:54.016367 4646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:45325 every 8 connection(s)
I20260812 06:23:54.016635 4393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:23:54.017668 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 4393
I20260812 06:23:54.017772 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:23:54.017949 30781 external_mini_cluster.cc:1428] Setting key d51e72761af63e9c578d04400b69d90e
Aug 12 06:23:54 dist-test-slave-gjrz krb5kdc[4182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515833, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:54.026316 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:54.017245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:53741 (local address 127.30.15.126:44649)
0812 06:23:54.017290 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:54.017292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:54.017475 (+ 183us) server_negotiation.cc:407] Connection header received
0812 06:23:54.018075 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:54.018077 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:54.018087 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:54.018162 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:54.019224 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.019736 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.020859 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.021198 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.021274 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:54.023446 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:54.023447 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:54.023447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:54.023456 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:54.024975 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:54.025336 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:54.025338 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:54.025338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:54.025398 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:54.025670 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:54.025670 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:54.025671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:54.025800 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:54.025874 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:54.026132 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 06:23:54.026224 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:23:54.026348 4649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:54.017220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44649 (local address 127.30.15.65:53741)
0812 06:23:54.017375 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:54.017405 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:54.017952 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:54.018223 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:54.018227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:54.018879 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:54.019127 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:54.019135 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.019821 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.019822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:54.020776 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:54.020779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.021275 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.021276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:54.021368 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:54.021795 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:54.021803 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:54.023357 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:54.025058 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:54.025065 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:54.025066 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:54.025265 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:54.025489 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:54.025491 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:54.025491 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:54.025599 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:54.025883 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:54.025889 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:54.025999 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 06:23:54.026087 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 06:23:54.026205 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":82,"threads_started":1}
I20260812 06:23:54.026809 4647 heartbeater.cc:347] Connected to a master server at 127.30.15.126:44649
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
I20260812 06:23:54.026911 4647 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:54.027098 4647 heartbeater.cc:511] Master 127.30.15.126:44649 requested a full tablet report, sending...
I20260812 06:23:54.027629 4279 ts_manager.cc:194] Registered new tserver with Master: 890aff7bbb774710bb089c5442ee8718 (127.30.15.65:45325)
I20260812 06:23:54.028290 4279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:53741
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:23:54.043529 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44649
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:45369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:54.121937 4655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:54.122121 4655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:54.122143 4655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:54.123301 4655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:54.123339 4655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:54.123366 4655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:23:54.124785 4655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:45369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:54.125000 4655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:54.125200 4655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:54.129825 4665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:54.129840 4669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:54.129873 4655 server_base.cc:1034] running on GCE node
W20260812 06:23:54.129837 4667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:54.130183 4655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:54.130398 4655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:54.131532 4655 hybrid_clock.cc:648] HybridClock initialized: now 1786515834131519 us; error 30 us; skew 500 ppm
Aug 12 06:23:54 dist-test-slave-gjrz krb5kdc[4182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515834, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:54.133809 4655 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:23:54.134229 4655 webserver.cc:460] Webserver started at http://127.30.15.66:37211/ using document root <none> and password file <none>
I20260812 06:23:54.134423 4655 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:54.134470 4655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:54.134591 4655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:54.135615 4655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "1da7214af16146a09ad1a6204e6b8ffe"
format_stamp: "Formatted at 2026-08-12 06:23:54 on dist-test-slave-gjrz"
server_key: "c9edfa7c0734e0e90110226d97849abf"
server_key_iv: "7a7f8d73ae250432f3c6023fc50d370d"
server_key_version: "encryptionkey@0"
I20260812 06:23:54.135957 4655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "1da7214af16146a09ad1a6204e6b8ffe"
format_stamp: "Formatted at 2026-08-12 06:23:54 on dist-test-slave-gjrz"
server_key: "c9edfa7c0734e0e90110226d97849abf"
server_key_iv: "7a7f8d73ae250432f3c6023fc50d370d"
server_key_version: "encryptionkey@0"
I20260812 06:23:54.137135 4655 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:23:54.137771 4688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:54.137952 4655 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:54.138041 4655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "1da7214af16146a09ad1a6204e6b8ffe"
format_stamp: "Formatted at 2026-08-12 06:23:54 on dist-test-slave-gjrz"
server_key: "c9edfa7c0734e0e90110226d97849abf"
server_key_iv: "7a7f8d73ae250432f3c6023fc50d370d"
server_key_version: "encryptionkey@0"
I20260812 06:23:54.138098 4655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:54.152319 4655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:54.154021 4655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:54.154146 4655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:54.154336 4655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:54.154619 4655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:54.154657 4655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:54.154685 4655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:54.154702 4655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:54.160151 4655 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:37957
I20260812 06:23:54.160188 4920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:37957 every 8 connection(s)
I20260812 06:23:54.160465 4655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:23:54 dist-test-slave-gjrz krb5kdc[4182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515834, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:54.167586 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 4655
I20260812 06:23:54.167689 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:23:54.167858 30781 external_mini_cluster.cc:1428] Setting key e3c7d0562d1ecac32b3a0847bdaeb095
I20260812 06:23:54.169464 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:54.161061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:39513 (local address 127.30.15.126:44649)
0812 06:23:54.161101 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:54.161103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:54.161303 (+ 200us) server_negotiation.cc:407] Connection header received
0812 06:23:54.161742 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:54.161743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:54.161753 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:54.161801 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:54.162929 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.163488 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.164570 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.164775 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.164830 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:54.166672 (+ 1842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:54.166673 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:54.166674 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:54.166681 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:54.167799 (+ 1118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:54.168228 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:54.168229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:54.168229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:54.168319 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:54.168634 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:54.168635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:54.168635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:54.168776 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:54.168843 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:54.169226 (+ 383us) server_negotiation.cc:299] Negotiation successful
0812 06:23:54.169336 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:23:54.171383 4925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:54.161059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44649 (local address 127.30.15.66:39513)
0812 06:23:54.161198 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:54.161229 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:54.161669 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:54.161849 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:54.161852 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:54.162539 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:54.162843 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:54.162849 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.163566 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.163567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:54.164487 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:54.164490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.164842 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.164843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:54.164969 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:54.165312 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:54.165318 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:54.166574 (+ 1256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:54.167862 (+ 1288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:54.167870 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:54.167872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:54.168138 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:54.168386 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:54.168387 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:54.168388 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:54.168535 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:54.168873 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:54.168880 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:54.169031 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 06:23:54.169170 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 06:23:54.169327 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":81,"threads_started":1}
I20260812 06:23:54.177390 4922 heartbeater.cc:347] Connected to a master server at 127.30.15.126:44649
I20260812 06:23:54.177508 4922 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:54.177700 4922 heartbeater.cc:511] Master 127.30.15.126:44649 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
I20260812 06:23:54.179451 4279 ts_manager.cc:194] Registered new tserver with Master: 1da7214af16146a09ad1a6204e6b8ffe (127.30.15.66:37957)
I20260812 06:23:54.179941 4279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:39513
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:23:54.195117 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44649
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:45369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:54.274631 4928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:54.274813 4928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:54.274833 4928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:54.275920 4928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:54.275954 4928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:54.275978 4928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:23:54.277318 4928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:45369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:54.277505 4928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:54.277670 4928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:54.282320 4940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:54.282298 4943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:54.282318 4939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:54.282574 4928 server_base.cc:1034] running on GCE node
I20260812 06:23:54.282791 4928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:54.283015 4928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:54.284160 4928 hybrid_clock.cc:648] HybridClock initialized: now 1786515834284149 us; error 26 us; skew 500 ppm
Aug 12 06:23:54 dist-test-slave-gjrz krb5kdc[4182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515834, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:54.286497 4928 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:23:54.286898 4928 webserver.cc:460] Webserver started at http://127.30.15.67:38753/ using document root <none> and password file <none>
I20260812 06:23:54.287065 4928 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:54.287101 4928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:54.287190 4928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:54.288189 4928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "6983b54b8fed40b695a49fc490eec37c"
format_stamp: "Formatted at 2026-08-12 06:23:54 on dist-test-slave-gjrz"
server_key: "b2fac21b01829a032142a6870f33062c"
server_key_iv: "216ff8005e2e062b05842fd463c8a3f2"
server_key_version: "encryptionkey@0"
I20260812 06:23:54.288529 4928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "6983b54b8fed40b695a49fc490eec37c"
format_stamp: "Formatted at 2026-08-12 06:23:54 on dist-test-slave-gjrz"
server_key: "b2fac21b01829a032142a6870f33062c"
server_key_iv: "216ff8005e2e062b05842fd463c8a3f2"
server_key_version: "encryptionkey@0"
I20260812 06:23:54.289697 4928 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:23:54.290334 4957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:54.290494 4928 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:54.290576 4928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "6983b54b8fed40b695a49fc490eec37c"
format_stamp: "Formatted at 2026-08-12 06:23:54 on dist-test-slave-gjrz"
server_key: "b2fac21b01829a032142a6870f33062c"
server_key_iv: "216ff8005e2e062b05842fd463c8a3f2"
server_key_version: "encryptionkey@0"
I20260812 06:23:54.290634 4928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:54.303391 4928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:54.305334 4928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:54.305461 4928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:54.305668 4928 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:54.305938 4928 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:54.305970 4928 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:54.305996 4928 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:54.306013 4928 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:54.311777 4928 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:33859
I20260812 06:23:54.311837 5157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:33859 every 8 connection(s)
I20260812 06:23:54.312094 4928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:23:54 dist-test-slave-gjrz krb5kdc[4182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515834, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:54.319257 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 4928
I20260812 06:23:54.319375 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:23:54.319581 30781 external_mini_cluster.cc:1428] Setting key 98d0e8312ba8b0290b688cad25192c06
I20260812 06:23:54.319914 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:54.312697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:40841 (local address 127.30.15.126:44649)
0812 06:23:54.312748 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:54.312750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:54.312908 (+ 158us) server_negotiation.cc:407] Connection header received
0812 06:23:54.313335 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:54.313336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:54.313345 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:54.313395 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:54.314191 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.314677 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.315668 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.315854 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.315904 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:54.317709 (+ 1805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:54.317711 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:54.317711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:54.317717 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:54.318723 (+ 1006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:54.319050 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:54.319051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:54.319051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:54.319099 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:54.319305 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:54.319306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:54.319306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:54.319438 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:54.319507 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:54.319760 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 06:23:54.319827 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:23:54.320148 5164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:54.312644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44649 (local address 127.30.15.67:40841)
0812 06:23:54.312800 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:54.312837 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:54.313264 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:54.313442 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:54.313444 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:54.313946 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:54.314129 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:54.314133 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.314735 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.314735 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:54.315601 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:54.315603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.315910 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.315911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:54.316016 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:54.316412 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:54.316420 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:54.317632 (+ 1212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:54.318787 (+ 1155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:54.318794 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:54.318796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:54.318998 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:54.319151 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:54.319152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:54.319152 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:54.319235 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:54.319507 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:54.319513 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:54.319626 (+ 113us) client_negotiation.cc:769] Sending connection context
0812 06:23:54.319727 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 06:23:54.319883 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
I20260812 06:23:54.320725 5159 heartbeater.cc:347] Connected to a master server at 127.30.15.126:44649
I20260812 06:23:54.320811 5159 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:54.320966 5159 heartbeater.cc:511] Master 127.30.15.126:44649 requested a full tablet report, sending...
I20260812 06:23:54.321321 4279 ts_manager.cc:194] Registered new tserver with Master: 6983b54b8fed40b695a49fc490eec37c (127.30.15.67:33859)
I20260812 06:23:54.321647 4279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:40841
I20260812 06:23:54.331362 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:23:54 dist-test-slave-gjrz krb5kdc[4182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515834, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 06:23:54 dist-test-slave-gjrz krb5kdc[4182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515834, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:54.352996 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:54.346841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60732 (local address 127.30.15.126:44649)
0812 06:23:54.346885 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:54.346887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:54.347003 (+ 116us) server_negotiation.cc:407] Connection header received
0812 06:23:54.347053 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:54.347054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:54.347062 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:54.347108 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:54.347647 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.348123 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.348799 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:54.348963 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:54.349003 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:54.351086 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:54.351088 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:54.351088 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:54.351095 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:54.352172 (+ 1077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:54.352460 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:54.352460 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:54.352461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:54.352500 (+ 39us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:54.352626 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:54.352627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:54.352627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:54.352744 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:54.352813 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:54.352880 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 06:23:54.352938 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 06:23:54.353223 4279 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60732
I20260812 06:23:54.353591 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 4393
I20260812 06:23:54.368729 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 4655
I20260812 06:23:54.378382 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 4928
I20260812 06:23:54.410565 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 4211
2026-08-12T06:23:54Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1970 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:23:54 dist-test-slave-gjrz krb5kdc[5180](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:23:54 dist-test-slave-gjrz krb5kdc[5180](info): set up 2 sockets
Aug 12 06:23:54 dist-test-slave-gjrz krb5kdc[5180](info): commencing operation
krb5kdc: starting...
W20260812 06:23:55.603785 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:23:55 dist-test-slave-gjrz krb5kdc[5180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:23:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:23:55.710156 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:39739
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:39739
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:55.789510 5205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:55.789686 5205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:55.789707 5205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:55.790843 5205 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:55.790884 5205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:55.790897 5205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:55.790908 5205 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:55.790920 5205 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:23:55.792413 5205 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:39739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:39739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:55.792632 5205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:55.792829 5205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:55.797327 5224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:55.797313 5220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:55.797314 5219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:55.797340 5205 server_base.cc:1034] running on GCE node
I20260812 06:23:55.797757 5205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:55.798022 5205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:55.799160 5205 hybrid_clock.cc:648] HybridClock initialized: now 1786515835799145 us; error 29 us; skew 500 ppm
Aug 12 06:23:55 dist-test-slave-gjrz krb5kdc[5180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515835, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:55.801477 5205 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:23:55.801900 5205 webserver.cc:460] Webserver started at http://127.30.15.126:34547/ using document root <none> and password file <none>
I20260812 06:23:55.802104 5205 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:55.802152 5205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:55.802270 5205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:55.803256 5205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "5af8f9e3b29046cda8b3fee099b9c02f"
format_stamp: "Formatted at 2026-08-12 06:23:55 on dist-test-slave-gjrz"
server_key: "5d72ce06db6a691fb8d16c92b0b98a4d"
server_key_iv: "45638f70f650e288762a152657e4275a"
server_key_version: "encryptionkey@0"
I20260812 06:23:55.803637 5205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "5af8f9e3b29046cda8b3fee099b9c02f"
format_stamp: "Formatted at 2026-08-12 06:23:55 on dist-test-slave-gjrz"
server_key: "5d72ce06db6a691fb8d16c92b0b98a4d"
server_key_iv: "45638f70f650e288762a152657e4275a"
server_key_version: "encryptionkey@0"
I20260812 06:23:55.804906 5205 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:55.805536 5236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:55.805685 5205 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:55.805764 5205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "5af8f9e3b29046cda8b3fee099b9c02f"
format_stamp: "Formatted at 2026-08-12 06:23:55 on dist-test-slave-gjrz"
server_key: "5d72ce06db6a691fb8d16c92b0b98a4d"
server_key_iv: "45638f70f650e288762a152657e4275a"
server_key_version: "encryptionkey@0"
I20260812 06:23:55.805830 5205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:55.811921 5205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:55.813817 5205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:55.813941 5205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:55.817698 5205 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:39739
I20260812 06:23:55.817739 5337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:39739 every 8 connection(s)
I20260812 06:23:55.818159 5205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:55.818748 5338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:55.820830 5338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f: Bootstrap starting.
I20260812 06:23:55.821349 5338 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:55.821597 5338 log.cc:824] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:55.822193 5338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f: No bootstrap required, opened a new log
I20260812 06:23:55.823721 5338 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af8f9e3b29046cda8b3fee099b9c02f" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39739 } }
I20260812 06:23:55.823861 5338 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:55.823882 5338 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af8f9e3b29046cda8b3fee099b9c02f, State: Initialized, Role: FOLLOWER
I20260812 06:23:55.823935 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 5205
I20260812 06:23:55.824031 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:55.824013 5338 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af8f9e3b29046cda8b3fee099b9c02f" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39739 } }
I20260812 06:23:55.824079 5338 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:55.824117 5338 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:55.824160 5338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:55.824200 30781 external_mini_cluster.cc:1428] Setting key 7758e42cf140433592fb46b89a93a067
I20260812 06:23:55.825228 5338 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af8f9e3b29046cda8b3fee099b9c02f" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39739 } }
I20260812 06:23:55.825337 5338 leader_election.cc:302] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5af8f9e3b29046cda8b3fee099b9c02f; no voters:
I20260812 06:23:55.825479 5338 leader_election.cc:288] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:55.825536 5346 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:55.825668 5346 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [term 1 LEADER]: Becoming Leader. State: Replica: 5af8f9e3b29046cda8b3fee099b9c02f, State: Running, Role: LEADER
I20260812 06:23:55.825716 5338 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:55.825760 5346 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af8f9e3b29046cda8b3fee099b9c02f" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39739 } }
I20260812 06:23:55.826424 5347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5af8f9e3b29046cda8b3fee099b9c02f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af8f9e3b29046cda8b3fee099b9c02f" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39739 } } }
I20260812 06:23:55.826570 5350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5af8f9e3b29046cda8b3fee099b9c02f. Latest consensus state: current_term: 1 leader_uuid: "5af8f9e3b29046cda8b3fee099b9c02f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af8f9e3b29046cda8b3fee099b9c02f" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39739 } } }
I20260812 06:23:55.826627 5350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:55.826560 5347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:55.826906 5373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:55.827410 5373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:55.829380 5373 catalog_manager.cc:1347] Generated new cluster ID: b6cc79ad5a604c3f8d2c4bf9fccc6ff3
I20260812 06:23:55.829434 5373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:23:55 dist-test-slave-gjrz krb5kdc[5180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:55.833726 5344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:55.824622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48594 (local address 127.30.15.126:39739)
0812 06:23:55.824798 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:55.824809 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:55.824848 (+ 39us) server_negotiation.cc:407] Connection header received
0812 06:23:55.824963 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:55.824969 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:55.825031 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:55.825170 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:55.825855 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:55.827275 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:55.828256 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:55.828735 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:55.828831 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:55.830949 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:55.830953 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:55.830954 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:55.830965 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:55.832410 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:55.832726 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:55.832729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:55.832729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:55.832822 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:55.832996 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:55.832997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:55.832997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:55.833215 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:55.833352 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:55.833454 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 06:23:55.833584 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260812 06:23:55.853406 5373 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:55.853863 5373 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:55.857856 5373 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5af8f9e3b29046cda8b3fee099b9c02f: Generated new TSK 0
I20260812 06:23:55.858021 5373 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:23:55.889670 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39739
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:55.969843 5384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:55.970039 5384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:55.970062 5384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:55.971123 5384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:55.971154 5384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:55.971179 5384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:23:55.972626 5384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39739
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:55.972792 5384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:55.972975 5384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:55.977630 5396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:55.977631 5403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:55.977763 5384 server_base.cc:1034] running on GCE node
W20260812 06:23:55.977862 5395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:55.978071 5384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:55.978309 5384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:55.979439 5384 hybrid_clock.cc:648] HybridClock initialized: now 1786515835979425 us; error 31 us; skew 500 ppm
Aug 12 06:23:55 dist-test-slave-gjrz krb5kdc[5180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515835, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:55.981663 5384 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:23:55.982093 5384 webserver.cc:460] Webserver started at http://127.30.15.65:39103/ using document root <none> and password file <none>
I20260812 06:23:55.982277 5384 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:55.982323 5384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:55.982443 5384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:55.983434 5384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "462bc9aeb2834a61b97548bd3804e5e3"
format_stamp: "Formatted at 2026-08-12 06:23:55 on dist-test-slave-gjrz"
server_key: "3730985b18a7c797cf0aeb8f0bbc4e9f"
server_key_iv: "9badf1d7e4fb707d9a66f7e1ce839f31"
server_key_version: "encryptionkey@0"
I20260812 06:23:55.983765 5384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "462bc9aeb2834a61b97548bd3804e5e3"
format_stamp: "Formatted at 2026-08-12 06:23:55 on dist-test-slave-gjrz"
server_key: "3730985b18a7c797cf0aeb8f0bbc4e9f"
server_key_iv: "9badf1d7e4fb707d9a66f7e1ce839f31"
server_key_version: "encryptionkey@0"
I20260812 06:23:55.984943 5384 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:55.985570 5415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:55.985710 5384 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:55.985787 5384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "462bc9aeb2834a61b97548bd3804e5e3"
format_stamp: "Formatted at 2026-08-12 06:23:55 on dist-test-slave-gjrz"
server_key: "3730985b18a7c797cf0aeb8f0bbc4e9f"
server_key_iv: "9badf1d7e4fb707d9a66f7e1ce839f31"
server_key_version: "encryptionkey@0"
I20260812 06:23:55.985844 5384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:55.992673 5384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:55.994275 5384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:55.994392 5384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:55.994572 5384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:55.994827 5384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:55.994858 5384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:55.994884 5384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:55.994908 5384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:56.000759 5384 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:40609
I20260812 06:23:56.000811 5624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:40609 every 8 connection(s)
I20260812 06:23:56.001081 5384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:23:56.003880 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 5384
I20260812 06:23:56.003970 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:23:56.004154 30781 external_mini_cluster.cc:1428] Setting key 1d1ab271328dedbde520c1a5219664b5
Aug 12 06:23:56 dist-test-slave-gjrz krb5kdc[5180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515835, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:56.010715 5344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:56.001693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:36131 (local address 127.30.15.126:39739)
0812 06:23:56.001734 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:56.001736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:56.001927 (+ 191us) server_negotiation.cc:407] Connection header received
0812 06:23:56.002838 (+ 911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:56.002839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:56.002851 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:56.002917 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:56.003511 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.004043 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.005316 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.005520 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.005574 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:56.007890 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:56.007891 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:56.007892 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:56.007901 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:56.009455 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:56.009830 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:56.009831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:56.009832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:56.009899 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:56.010117 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:56.010118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:56.010118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:56.010258 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:56.010327 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:56.010535 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 06:23:56.010623 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:23:56.010761 5629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:56.001650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39739 (local address 127.30.15.65:36131)
0812 06:23:56.001802 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:56.001841 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:56.002758 (+ 917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:56.002974 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:56.002977 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:56.003230 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:56.003447 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:56.003452 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.004133 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.004134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:56.005233 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:56.005237 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.005596 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.005597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:56.005726 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:56.006146 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:56.006156 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:56.007807 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:56.009547 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:56.009554 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:56.009556 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:56.009761 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:56.009963 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:56.009963 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:56.009964 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:56.010060 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:56.010316 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:56.010319 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:56.010420 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 06:23:56.010494 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:23:56.010615 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":87,"threads_started":1}
I20260812 06:23:56.011245 5626 heartbeater.cc:347] Connected to a master server at 127.30.15.126:39739
I20260812 06:23:56.011358 5626 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:56.011520 5626 heartbeater.cc:511] Master 127.30.15.126:39739 requested a full tablet report, sending...
I20260812 06:23:56.012091 5273 ts_manager.cc:194] Registered new tserver with Master: 462bc9aeb2834a61b97548bd3804e5e3 (127.30.15.65:40609)
I20260812 06:23:56.012950 5273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:36131
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:23:56.027768 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39739
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:56.106243 5635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:56.106420 5635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:56.106441 5635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:56.107582 5635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:56.107621 5635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:56.107646 5635 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:23:56.109153 5635 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39739
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:56.109367 5635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:56.109562 5635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:56.114209 5644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:56.114235 5635 server_base.cc:1034] running on GCE node
W20260812 06:23:56.114209 5650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:56.114238 5643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:56.114615 5635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:56.114825 5635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:56.115971 5635 hybrid_clock.cc:648] HybridClock initialized: now 1786515836115955 us; error 29 us; skew 500 ppm
Aug 12 06:23:56 dist-test-slave-gjrz krb5kdc[5180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515836, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:56.118393 5635 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:23:56.118768 5635 webserver.cc:460] Webserver started at http://127.30.15.66:36903/ using document root <none> and password file <none>
I20260812 06:23:56.118944 5635 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:56.118983 5635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:56.119069 5635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:56.120054 5635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "dc783f6c6eb64105b97bc62fcd9dc4d2"
format_stamp: "Formatted at 2026-08-12 06:23:56 on dist-test-slave-gjrz"
server_key: "53219c9d84f596f42bb8498509a71422"
server_key_iv: "7784c19623e7126a4db99bfa8e58069e"
server_key_version: "encryptionkey@0"
I20260812 06:23:56.120337 5635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "dc783f6c6eb64105b97bc62fcd9dc4d2"
format_stamp: "Formatted at 2026-08-12 06:23:56 on dist-test-slave-gjrz"
server_key: "53219c9d84f596f42bb8498509a71422"
server_key_iv: "7784c19623e7126a4db99bfa8e58069e"
server_key_version: "encryptionkey@0"
I20260812 06:23:56.121524 5635 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:23:56.122186 5667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:56.122321 5635 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:56.122404 5635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "dc783f6c6eb64105b97bc62fcd9dc4d2"
format_stamp: "Formatted at 2026-08-12 06:23:56 on dist-test-slave-gjrz"
server_key: "53219c9d84f596f42bb8498509a71422"
server_key_iv: "7784c19623e7126a4db99bfa8e58069e"
server_key_version: "encryptionkey@0"
I20260812 06:23:56.122465 5635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:56.146827 5635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:56.148867 5635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:56.149003 5635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:56.149202 5635 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:56.149482 5635 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:56.149515 5635 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:56.149535 5635 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:56.149554 5635 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:56.154985 5635 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:46227
I20260812 06:23:56.155031 5882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:46227 every 8 connection(s)
I20260812 06:23:56.155323 5635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:23:56 dist-test-slave-gjrz krb5kdc[5180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515836, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:56.162052 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 5635
I20260812 06:23:56.162145 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:23:56.162324 30781 external_mini_cluster.cc:1428] Setting key 790bb6b7aedfbcde019263af238d3e08
I20260812 06:23:56.163712 5344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:56.156014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:60149 (local address 127.30.15.126:39739)
0812 06:23:56.156061 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:56.156063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:56.156249 (+ 186us) server_negotiation.cc:407] Connection header received
0812 06:23:56.157128 (+ 879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:56.157129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:56.157139 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:56.157191 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:56.157709 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.158209 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.159127 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.159344 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.159387 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:56.161244 (+ 1857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:56.161245 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:56.161246 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:56.161252 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:56.162378 (+ 1126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:56.162764 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:56.162765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:56.162765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:56.162822 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:56.163076 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:56.163077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:56.163077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:56.163217 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:56.163312 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:56.163530 (+ 218us) server_negotiation.cc:299] Negotiation successful
0812 06:23:56.163619 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:23:56.163769 5888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:56.155972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39739 (local address 127.30.15.66:60149)
0812 06:23:56.156131 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:56.156171 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:56.157047 (+ 876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:56.157245 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:56.157248 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:56.157471 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:56.157646 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:56.157650 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.158273 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.158274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:56.159066 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:56.159068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.159404 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.159405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:56.159505 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:56.159907 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:56.159923 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:56.161166 (+ 1243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:56.162444 (+ 1278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:56.162451 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:56.162453 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:56.162697 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:56.162882 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:56.162883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:56.162883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:56.163014 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:56.163293 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:56.163298 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:56.163419 (+ 121us) client_negotiation.cc:769] Sending connection context
0812 06:23:56.163499 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 06:23:56.163620 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":92,"threads_started":1}
I20260812 06:23:56.164189 5883 heartbeater.cc:347] Connected to a master server at 127.30.15.126:39739
I20260812 06:23:56.164281 5883 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:56.164439 5883 heartbeater.cc:511] Master 127.30.15.126:39739 requested a full tablet report, sending...
I20260812 06:23:56.164845 5273 ts_manager.cc:194] Registered new tserver with Master: dc783f6c6eb64105b97bc62fcd9dc4d2 (127.30.15.66:46227)
I20260812 06:23:56.165201 5273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:60149
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:23:56.185563 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39739
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:56.265626 5894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:56.265801 5894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:56.265823 5894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:56.266935 5894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:56.266974 5894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:56.267002 5894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:23:56.268483 5894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39739
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:56.268685 5894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:56.268878 5894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:56.273532 5924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:56.273629 5894 server_base.cc:1034] running on GCE node
W20260812 06:23:56.273527 5911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:56.273531 5912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:56.273947 5894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:56.274156 5894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:56.275310 5894 hybrid_clock.cc:648] HybridClock initialized: now 1786515836275296 us; error 29 us; skew 500 ppm
Aug 12 06:23:56 dist-test-slave-gjrz krb5kdc[5180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515836, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:56.277559 5894 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:23:56.277941 5894 webserver.cc:460] Webserver started at http://127.30.15.67:37845/ using document root <none> and password file <none>
I20260812 06:23:56.278123 5894 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:56.278168 5894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:56.278285 5894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:56.279212 5894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "01d50a93a3414a4393e076d8029d8a03"
format_stamp: "Formatted at 2026-08-12 06:23:56 on dist-test-slave-gjrz"
server_key: "5abf62e7d43133af1bd15b4e67be9eda"
server_key_iv: "13d146630cc38fa1e3c9d5b26a74af8d"
server_key_version: "encryptionkey@0"
I20260812 06:23:56.279582 5894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "01d50a93a3414a4393e076d8029d8a03"
format_stamp: "Formatted at 2026-08-12 06:23:56 on dist-test-slave-gjrz"
server_key: "5abf62e7d43133af1bd15b4e67be9eda"
server_key_iv: "13d146630cc38fa1e3c9d5b26a74af8d"
server_key_version: "encryptionkey@0"
I20260812 06:23:56.280737 5894 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:56.281371 5940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:56.281513 5894 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:56.281598 5894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "01d50a93a3414a4393e076d8029d8a03"
format_stamp: "Formatted at 2026-08-12 06:23:56 on dist-test-slave-gjrz"
server_key: "5abf62e7d43133af1bd15b4e67be9eda"
server_key_iv: "13d146630cc38fa1e3c9d5b26a74af8d"
server_key_version: "encryptionkey@0"
I20260812 06:23:56.281661 5894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:56.300835 5894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:56.302384 5894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:56.302505 5894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:56.302700 5894 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:56.302958 5894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:56.302990 5894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:56.303017 5894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:56.303035 5894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:56.308734 5894 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:34769
I20260812 06:23:56.308773 6163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:34769 every 8 connection(s)
I20260812 06:23:56.309039 5894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:23:56.309988 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 5894
I20260812 06:23:56.310082 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:23:56.310259 30781 external_mini_cluster.cc:1428] Setting key 709548cdfe1b198531fb71644d94b4f0
Aug 12 06:23:56 dist-test-slave-gjrz krb5kdc[5180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515836, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:56.317262 5344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:56.309720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:34857 (local address 127.30.15.126:39739)
0812 06:23:56.309766 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:56.309768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:56.309954 (+ 186us) server_negotiation.cc:407] Connection header received
0812 06:23:56.310958 (+ 1004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:56.310959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:56.310971 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:56.311031 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:56.311689 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.312195 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.313096 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.313268 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.313310 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:56.315061 (+ 1751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:56.315062 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:56.315062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:56.315068 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:56.316297 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:56.316606 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:56.316607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:56.316607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:56.316652 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:56.316816 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:56.316816 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:56.316816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:56.316905 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:56.316965 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:56.317146 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 06:23:56.317202 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:23:56.317410 6168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:56.309687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39739 (local address 127.30.15.67:34857)
0812 06:23:56.309830 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:56.309867 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:56.310860 (+ 993us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:56.311095 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:56.311099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:56.311381 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:56.311563 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:56.311590 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.312265 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.312265 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:56.313035 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:56.313037 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.313318 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.313319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:56.313406 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:56.313766 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:56.313773 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:56.314986 (+ 1213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:56.316353 (+ 1367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:56.316357 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:56.316358 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:56.316553 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:56.316693 (+ 140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:56.316694 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:56.316694 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:56.316775 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:56.316961 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:56.316963 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:56.317061 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 06:23:56.317130 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:23:56.317233 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260812 06:23:56.317798 6165 heartbeater.cc:347] Connected to a master server at 127.30.15.126:39739
I20260812 06:23:56.317878 6165 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:56.318037 6165 heartbeater.cc:511] Master 127.30.15.126:39739 requested a full tablet report, sending...
I20260812 06:23:56.318351 5273 ts_manager.cc:194] Registered new tserver with Master: 01d50a93a3414a4393e076d8029d8a03 (127.30.15.67:34769)
I20260812 06:23:56.318671 5273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:34857
I20260812 06:23:56.321745 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:23:56 dist-test-slave-gjrz krb5kdc[5180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:23:56 dist-test-slave-gjrz krb5kdc[5180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.65@KRBTEST.COM
I20260812 06:23:56.343827 6181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:56.337138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41516 (local address 127.30.15.65:40609)
0812 06:23:56.337305 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:56.337309 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:56.337318 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:23:56.337341 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:56.337343 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:56.337355 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:56.337421 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:56.337978 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.338653 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.339391 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.339685 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.339731 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:56.341659 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:56.341666 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:56.341666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:56.341672 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:56.342917 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:56.343201 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:56.343203 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:56.343203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:56.343251 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:56.343408 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:56.343409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:56.343409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:56.343522 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:56.343629 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:56.343679 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 06:23:56.343737 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":98,"threads_started":1}
Aug 12 06:23:56 dist-test-slave-gjrz krb5kdc[5180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:56.350907 5344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:56.344905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48610 (local address 127.30.15.126:39739)
0812 06:23:56.344964 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:56.344966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:56.344974 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:23:56.345040 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:56.345041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:56.345050 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:56.345095 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:56.345511 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.345960 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.346588 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:56.346779 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:56.346830 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:56.348757 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:56.348758 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:56.348759 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:56.348765 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:56.349922 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:56.350214 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:56.350215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:56.350215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:56.350266 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:56.350424 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:56.350425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:56.350425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:56.350566 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:56.350651 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:56.350751 (+ 100us) server_negotiation.cc:299] Negotiation successful
0812 06:23:56.350822 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260812 06:23:56.351118 5273 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48610
I20260812 06:23:56.351413 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 5384
I20260812 06:23:56.363363 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 5635
I20260812 06:23:56.372251 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 5894
I20260812 06:23:56.389566 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 5205
2026-08-12T06:23:56Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1978 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:23:56 dist-test-slave-gjrz krb5kdc[6188](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:23:56 dist-test-slave-gjrz krb5kdc[6188](info): set up 2 sockets
Aug 12 06:23:56 dist-test-slave-gjrz krb5kdc[6188](info): commencing operation
krb5kdc: starting...
W20260812 06:23:57.581140 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:23:57 dist-test-slave-gjrz krb5kdc[6188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:23:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:23:57.689723 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:38371
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:38371
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:57.768682 6206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:57.768857 6206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:57.768884 6206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:57.769985 6206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:57.770021 6206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:57.770040 6206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:57.770056 6206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:57.770071 6206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:23:57.771555 6206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:38371
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:38371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:57.771777 6206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:57.771974 6206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:23:57.776404 6206 server_base.cc:1034] running on GCE node
W20260812 06:23:57.776377 6213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:57.776337 6216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:57.776353 6212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:57.776834 6206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:57.777112 6206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:57.778249 6206 hybrid_clock.cc:648] HybridClock initialized: now 1786515837778234 us; error 28 us; skew 500 ppm
Aug 12 06:23:57 dist-test-slave-gjrz krb5kdc[6188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515837, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:57.783355 6206 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:23:57.783658 6206 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:57.783706 6206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:57.783823 6206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:57.784757 6206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "fde7f97737d54aa4bc0cfd40ba3cc96f"
format_stamp: "Formatted at 2026-08-12 06:23:57 on dist-test-slave-gjrz"
server_key: "bf7273801bb8b9980a4cbc80a83eb4fe"
server_key_iv: "df10e6b908828bb3f4ed9dddac373723"
server_key_version: "encryptionkey@0"
I20260812 06:23:57.785068 6206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "fde7f97737d54aa4bc0cfd40ba3cc96f"
format_stamp: "Formatted at 2026-08-12 06:23:57 on dist-test-slave-gjrz"
server_key: "bf7273801bb8b9980a4cbc80a83eb4fe"
server_key_iv: "df10e6b908828bb3f4ed9dddac373723"
server_key_version: "encryptionkey@0"
I20260812 06:23:57.786217 6206 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:23:57.786824 6231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:57.786988 6206 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:57.787067 6206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "fde7f97737d54aa4bc0cfd40ba3cc96f"
format_stamp: "Formatted at 2026-08-12 06:23:57 on dist-test-slave-gjrz"
server_key: "bf7273801bb8b9980a4cbc80a83eb4fe"
server_key_iv: "df10e6b908828bb3f4ed9dddac373723"
server_key_version: "encryptionkey@0"
I20260812 06:23:57.787127 6206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:57.795491 6206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:57.797362 6206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:57.797489 6206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:57.801118 6206 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:38371
I20260812 06:23:57.801143 6346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:38371 every 8 connection(s)
I20260812 06:23:57.801378 6206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:57.802254 6349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:57.803599 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 6206
I20260812 06:23:57.803700 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:57.803853 30781 external_mini_cluster.cc:1428] Setting key 955859aa319293b2206696aa82149ed4
I20260812 06:23:57.804522 6349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f: Bootstrap starting.
I20260812 06:23:57.805107 6349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:57.805440 6349 log.cc:824] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:57.806110 6349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f: No bootstrap required, opened a new log
I20260812 06:23:57.808074 6349 raft_consensus.cc:348] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde7f97737d54aa4bc0cfd40ba3cc96f" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38371 } }
I20260812 06:23:57.808207 6349 raft_consensus.cc:374] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:57.808241 6349 raft_consensus.cc:729] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fde7f97737d54aa4bc0cfd40ba3cc96f, State: Initialized, Role: FOLLOWER
I20260812 06:23:57.808394 6349 consensus_queue.cc:260] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde7f97737d54aa4bc0cfd40ba3cc96f" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38371 } }
I20260812 06:23:57.808481 6349 raft_consensus.cc:388] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:57.808506 6349 raft_consensus.cc:482] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:57.808552 6349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:57.809041 6349 raft_consensus.cc:504] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde7f97737d54aa4bc0cfd40ba3cc96f" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38371 } }
I20260812 06:23:57.809134 6349 leader_election.cc:302] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fde7f97737d54aa4bc0cfd40ba3cc96f; no voters:
I20260812 06:23:57.809270 6349 leader_election.cc:288] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:57.809312 6357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:57.809453 6357 raft_consensus.cc:686] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [term 1 LEADER]: Becoming Leader. State: Replica: fde7f97737d54aa4bc0cfd40ba3cc96f, State: Running, Role: LEADER
I20260812 06:23:57.809515 6349 sys_catalog.cc:564] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:57.809610 6357 consensus_queue.cc:237] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde7f97737d54aa4bc0cfd40ba3cc96f" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38371 } }
I20260812 06:23:57.809971 6357 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fde7f97737d54aa4bc0cfd40ba3cc96f. Latest consensus state: current_term: 1 leader_uuid: "fde7f97737d54aa4bc0cfd40ba3cc96f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde7f97737d54aa4bc0cfd40ba3cc96f" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38371 } } }
Aug 12 06:23:57 dist-test-slave-gjrz krb5kdc[6188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:57.810048 6357 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:57.810211 6359 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fde7f97737d54aa4bc0cfd40ba3cc96f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde7f97737d54aa4bc0cfd40ba3cc96f" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38371 } } }
I20260812 06:23:57.810277 6359 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:57.810423 6374 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:57.811065 6374 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:57.812449 6374 catalog_manager.cc:1347] Generated new cluster ID: 77e56d71eea246dcb4547e397b635f45
I20260812 06:23:57.812505 6374 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:23:57.814417 6354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:57.804305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34754 (local address 127.30.15.126:38371)
0812 06:23:57.804443 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:57.804450 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:57.804480 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:23:57.804860 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:57.804865 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:57.804917 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:57.805026 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:57.805798 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:57.806704 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:57.807758 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:57.808131 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:57.808213 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:57.810580 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:57.810584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:57.810584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:57.810595 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:57.812451 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:57.812845 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:57.812848 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:57.812848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:57.812944 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:57.813136 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:57.813137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:57.813137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:57.813457 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:57.813599 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:57.814083 (+ 484us) server_negotiation.cc:299] Negotiation successful
0812 06:23:57.814212 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260812 06:23:57.819059 6374 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:57.819582 6374 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:57.829002 6374 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f: Generated new TSK 0
I20260812 06:23:57.829139 6374 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:23:57.856137 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38371
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:57.946719 6403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:57.946943 6403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:57.946982 6403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:57.948135 6403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:57.948174 6403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:57.948210 6403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:23:57.949683 6403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:57.949949 6403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:57.950153 6403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:57.954777 6419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:57.954780 6418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:57.954773 6421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:57.954869 6403 server_base.cc:1034] running on GCE node
I20260812 06:23:57.955180 6403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:57.955412 6403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:57.956555 6403 hybrid_clock.cc:648] HybridClock initialized: now 1786515837956541 us; error 31 us; skew 500 ppm
Aug 12 06:23:57 dist-test-slave-gjrz krb5kdc[6188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515837, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:57.958920 6403 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:23:57.959239 6403 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:57.959318 6403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:57.959414 6403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:57.960330 6403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "1852755b20314c6ba8aee01585915ba3"
format_stamp: "Formatted at 2026-08-12 06:23:57 on dist-test-slave-gjrz"
server_key: "311a17dfe528cf3d9fade73a33424705"
server_key_iv: "3ecda2d0a64bb2db30c6280924a9974a"
server_key_version: "encryptionkey@0"
I20260812 06:23:57.960659 6403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "1852755b20314c6ba8aee01585915ba3"
format_stamp: "Formatted at 2026-08-12 06:23:57 on dist-test-slave-gjrz"
server_key: "311a17dfe528cf3d9fade73a33424705"
server_key_iv: "3ecda2d0a64bb2db30c6280924a9974a"
server_key_version: "encryptionkey@0"
I20260812 06:23:57.961800 6403 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:23:57.962450 6430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:57.962594 6403 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:57.962667 6403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "1852755b20314c6ba8aee01585915ba3"
format_stamp: "Formatted at 2026-08-12 06:23:57 on dist-test-slave-gjrz"
server_key: "311a17dfe528cf3d9fade73a33424705"
server_key_iv: "3ecda2d0a64bb2db30c6280924a9974a"
server_key_version: "encryptionkey@0"
I20260812 06:23:57.962729 6403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:57.981060 6403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:57.982936 6403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:57.983055 6403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:57.983246 6403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:57.983549 6403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:57.983582 6403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:57.983603 6403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:57.983625 6403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:57.989399 6403 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:41785
I20260812 06:23:57.989444 6657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:41785 every 8 connection(s)
I20260812 06:23:57.989687 6403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:23:57.990906 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 6403
I20260812 06:23:57.990998 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:23:57.991163 30781 external_mini_cluster.cc:1428] Setting key 1b303df5cf02e517b587cd1019686d2f
Aug 12 06:23:57 dist-test-slave-gjrz krb5kdc[6188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515837, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:57.999069 6354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:57.990323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:59345 (local address 127.30.15.126:38371)
0812 06:23:57.990365 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:57.990367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:57.990530 (+ 163us) server_negotiation.cc:407] Connection header received
0812 06:23:57.991081 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:57.991082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:57.991094 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:57.991144 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:57.992289 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:57.992799 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:57.994058 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:57.994270 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:57.994319 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:57.996394 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:57.996396 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:57.996396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:57.996404 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:57.997840 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:57.998199 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:57.998200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:57.998201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:57.998263 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:57.998455 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:57.998455 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:57.998456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:57.998599 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:57.998665 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:57.998894 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 06:23:57.998980 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:23:57.999135 6661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:57.990293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:38371 (local address 127.30.15.65:59345)
0812 06:23:57.990436 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:57.990468 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:57.990950 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:57.991210 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:57.991215 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:57.991636 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:57.992193 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:57.992200 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:57.992884 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:57.992885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:57.993952 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:57.993956 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:57.994346 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:57.994347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:57.994476 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:57.994856 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:57.994865 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:57.996311 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:57.997917 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:57.997924 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:57.997925 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:57.998132 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:57.998321 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:57.998321 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:57.998321 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:57.998404 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:57.998663 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:57.998669 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:57.998775 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 06:23:57.998851 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 06:23:57.998967 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":83,"threads_started":1}
I20260812 06:23:57.999692 6658 heartbeater.cc:347] Connected to a master server at 127.30.15.126:38371
I20260812 06:23:57.999778 6658 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:57.999912 6658 heartbeater.cc:511] Master 127.30.15.126:38371 requested a full tablet report, sending...
I20260812 06:23:58.000375 6276 ts_manager.cc:194] Registered new tserver with Master: 1852755b20314c6ba8aee01585915ba3 (127.30.15.65:41785)
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
I20260812 06:23:58.000967 6276 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:59345
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:23:58.017212 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38371
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:58.097157 6665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:58.097334 6665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:58.097357 6665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:58.098423 6665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:58.098454 6665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:58.098479 6665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:23:58.099943 6665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:58.100124 6665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:58.100286 6665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:58.104980 6676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:58.105079 6675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:58.105186 6665 server_base.cc:1034] running on GCE node
W20260812 06:23:58.105023 6678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:58.105437 6665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:58.105647 6665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:58.106774 6665 hybrid_clock.cc:648] HybridClock initialized: now 1786515838106767 us; error 29 us; skew 500 ppm
Aug 12 06:23:58 dist-test-slave-gjrz krb5kdc[6188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515838, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:58.109130 6665 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:23:58.109431 6665 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:58.109475 6665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:58.109604 6665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:58.110636 6665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "daab7c208ad14ef8995bd128b13e47d6"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "01410d3205642988046ef58894a70ba7"
server_key_iv: "4f5d80615054e76d380c9027554c61ca"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.110945 6665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "daab7c208ad14ef8995bd128b13e47d6"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "01410d3205642988046ef58894a70ba7"
server_key_iv: "4f5d80615054e76d380c9027554c61ca"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.112160 6665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:23:58.112849 6694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.112998 6665 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.113070 6665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "daab7c208ad14ef8995bd128b13e47d6"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "01410d3205642988046ef58894a70ba7"
server_key_iv: "4f5d80615054e76d380c9027554c61ca"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.113135 6665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:58.124984 6665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:58.126911 6665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:58.127035 6665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:58.127228 6665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:58.127519 6665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:58.127557 6665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.127583 6665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:58.127600 6665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.133096 6665 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:45905
I20260812 06:23:58.133154 6913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:45905 every 8 connection(s)
I20260812 06:23:58.133363 6665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:23:58 dist-test-slave-gjrz krb5kdc[6188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515838, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:58.141738 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 6665
I20260812 06:23:58.141755 6354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.133999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:40639 (local address 127.30.15.126:38371)
0812 06:23:58.134054 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.134056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.134216 (+ 160us) server_negotiation.cc:407] Connection header received
0812 06:23:58.134677 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.134678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.134691 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.134738 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:58.135660 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.136161 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.137129 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.137325 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.137383 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.139285 (+ 1902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:58.139287 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:58.139288 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:58.139295 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:58.140500 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:58.140901 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:58.140902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:58.140902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:58.140956 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:58.141180 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:58.141182 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:58.141182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:58.141299 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:58.141362 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.141571 (+ 209us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.141668 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:23:58.141815 6919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.133949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:38371 (local address 127.30.15.66:40639)
0812 06:23:58.134107 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.134145 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.134583 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.134812 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.134816 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.135056 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:58.135570 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.135576 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.136245 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.136247 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.137045 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.137047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.137406 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.137408 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.137522 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.137905 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:58.137913 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:58.139187 (+ 1274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:58.140589 (+ 1402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:58.140597 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:58.140598 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:58.140809 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:58.141006 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:58.141006 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:58.141006 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:58.141102 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:58.141360 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:58.141363 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:58.141467 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.141543 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.141654 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
I20260812 06:23:58.141839 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:23:58.142023 30781 external_mini_cluster.cc:1428] Setting key 2b6b27182f4e03a22e44dfa2be8d218d
I20260812 06:23:58.142347 6914 heartbeater.cc:347] Connected to a master server at 127.30.15.126:38371
I20260812 06:23:58.142442 6914 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:58.142589 6914 heartbeater.cc:511] Master 127.30.15.126:38371 requested a full tablet report, sending...
I20260812 06:23:58.142969 6276 ts_manager.cc:194] Registered new tserver with Master: daab7c208ad14ef8995bd128b13e47d6 (127.30.15.66:45905)
I20260812 06:23:58.143421 6276 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:40639
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:23:58.165784 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38371
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:23:58.244630 6929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:58.244808 6929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:58.244830 6929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:58.245894 6929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:58.245927 6929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:58.245960 6929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:23:58.247646 6929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:58.247820 6929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:58.247987 6929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:58.252642 6944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:58.252630 6942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:58.252660 6929 server_base.cc:1034] running on GCE node
W20260812 06:23:58.252630 6941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:58.253033 6929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:58.253240 6929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:58.254390 6929 hybrid_clock.cc:648] HybridClock initialized: now 1786515838254376 us; error 27 us; skew 500 ppm
Aug 12 06:23:58 dist-test-slave-gjrz krb5kdc[6188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515838, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:23:58.256755 6929 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:23:58.257082 6929 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:58.257129 6929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:58.257220 6929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:58.258155 6929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "3adfebd6012b4154b4e81c9bb129499e"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "1e04727ce995718deb0d9720093c1326"
server_key_iv: "96308387ca034f2e9979c96c78cbd1ea"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.258440 6929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "3adfebd6012b4154b4e81c9bb129499e"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "1e04727ce995718deb0d9720093c1326"
server_key_iv: "96308387ca034f2e9979c96c78cbd1ea"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.259624 6929 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260812 06:23:58.260241 6952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.260406 6929 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.260489 6929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "3adfebd6012b4154b4e81c9bb129499e"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "1e04727ce995718deb0d9720093c1326"
server_key_iv: "96308387ca034f2e9979c96c78cbd1ea"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.260547 6929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:58.276705 6929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:58.278653 6929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:58.278780 6929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:58.278978 6929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:58.279246 6929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:58.279321 6929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.279349 6929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:58.279366 6929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.285023 6929 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:43925
I20260812 06:23:58.285081 7182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:43925 every 8 connection(s)
I20260812 06:23:58.285298 6929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:23:58.289934 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 6929
I20260812 06:23:58.290015 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:23:58.290174 30781 external_mini_cluster.cc:1428] Setting key 342e5856c3bf5ba7c127bd0a2316390c
Aug 12 06:23:58 dist-test-slave-gjrz krb5kdc[6188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515838, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:23:58.293632 6354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.285907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:35153 (local address 127.30.15.126:38371)
0812 06:23:58.285953 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.285955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.286130 (+ 175us) server_negotiation.cc:407] Connection header received
0812 06:23:58.286591 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.286592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.286605 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.286654 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:58.287534 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.288034 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.288999 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.289209 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.289268 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.291453 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:58.291454 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:58.291454 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:58.291461 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:58.292663 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:58.292980 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:58.292980 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:58.292981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:58.293026 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:58.293193 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:58.293194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:58.293194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:58.293284 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:58.293328 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.293515 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.293570 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:23:58.293777 7192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.285852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:38371 (local address 127.30.15.67:35153)
0812 06:23:58.286018 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.286053 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.286495 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.286720 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.286724 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.286972 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:58.287441 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.287446 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.288116 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.288117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.288909 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.288911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.289282 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.289283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.289403 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.289750 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:23:58.289758 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:58.291367 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:58.292730 (+ 1363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:58.292736 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:58.292737 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:58.292926 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:58.293069 (+ 143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:23:58.293070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:23:58.293070 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:23:58.293154 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:23:58.293324 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:58.293327 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:58.293424 (+ 97us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.293494 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.293600 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":88,"threads_started":1}
I20260812 06:23:58.294232 7186 heartbeater.cc:347] Connected to a master server at 127.30.15.126:38371
I20260812 06:23:58.294306 7186 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:58.294416 7186 heartbeater.cc:511] Master 127.30.15.126:38371 requested a full tablet report, sending...
I20260812 06:23:58.294735 6276 ts_manager.cc:194] Registered new tserver with Master: 3adfebd6012b4154b4e81c9bb129499e (127.30.15.67:43925)
I20260812 06:23:58.295080 6276 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:35153
I20260812 06:23:58.301641 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:23:58.308354 6354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.302995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34760 (local address 127.30.15.126:38371)
0812 06:23:58.303037 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.303039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.303046 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:23:58.303097 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.303098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.303107 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.303152 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:58.303745 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.304193 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.304897 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.305079 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.305133 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.306185 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:58.306187 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:58.306187 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:23:58.306194 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:58.307375 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:58.307665 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:58.307666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:58.307666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:58.307716 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:23:58.307874 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:23:58.307874 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:23:58.307875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:23:58.308017 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:58.308106 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.308204 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.308273 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:23:58.309712 6276 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:23:58.311250 6276 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:23:58.317184 7208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.313418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:41785 (local address 127.0.0.1:59046)
0812 06:23:58.313520 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.313530 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.313579 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.313919 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.313920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.313922 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:58.313961 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.313963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.314926 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.314927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.316033 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.316036 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.316894 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.316895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.316983 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.316996 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.317057 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.317106 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":36,"threads_started":1}
I20260812 06:23:58.317239 7206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.313241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:43925 (local address 127.0.0.1:56172)
0812 06:23:58.313336 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.313365 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.313419 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.313835 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.313838 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.313840 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:58.313904 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.313906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.315313 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.315314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.316251 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.316253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.317008 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.317009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.317063 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.317065 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.317112 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.317141 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"thread_start_us":42,"threads_started":1}
I20260812 06:23:58.317231 7207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.313325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56172 (local address 127.30.15.67:43925)
0812 06:23:58.313678 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.313682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.313692 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:23:58.313719 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.313721 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.313732 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.314049 (+ 317us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:58.314107 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.315163 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.316352 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.316895 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.317002 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.317059 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.317121 (+ 62us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.317154 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":122,"threads_started":1}
I20260812 06:23:58.317435 7212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.313533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59046 (local address 127.30.15.65:41785)
0812 06:23:58.313727 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.313733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.313744 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:23:58.313825 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.313828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.313843 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.313925 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:58.314033 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.314837 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.316125 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.316824 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.316883 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.316942 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.317310 (+ 368us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.317360 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":85,"threads_started":1}
I20260812 06:23:58.318020 6519 tablet_service.cc:1467] Processing CreateTablet for tablet c5d7763c6afa45c699089e39d74a7816 (DEFAULT_TABLE table=test-table [id=58835c7c58c4451592469dad260a6087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:58.318006 7056 tablet_service.cc:1467] Processing CreateTablet for tablet c5d7763c6afa45c699089e39d74a7816 (DEFAULT_TABLE table=test-table [id=58835c7c58c4451592469dad260a6087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:58.318356 6519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5d7763c6afa45c699089e39d74a7816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:58.318354 7056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5d7763c6afa45c699089e39d74a7816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:58.321604 7216 tablet_bootstrap.cc:492] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3: Bootstrap starting.
I20260812 06:23:58.321774 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.313544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:45905 (local address 127.0.0.1:45212)
0812 06:23:58.313849 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.313859 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.313910 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.314244 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.314245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.314247 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:58.314280 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.314281 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.315532 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.315533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.316572 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.316574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.317559 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.317560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.317623 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.317628 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.321653 (+ 4025us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.321699 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":58,"threads_started":1}
I20260812 06:23:58.322005 7214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.313667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45212 (local address 127.30.15.66:45905)
0812 06:23:58.313855 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.313858 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.314024 (+ 166us) server_negotiation.cc:407] Connection header received
0812 06:23:58.314070 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.314072 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.314087 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.314156 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:58.314355 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.315413 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.316694 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.317394 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.317465 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.317524 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.321887 (+ 4363us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.321934 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":89,"threads_started":1}
I20260812 06:23:58.322302 7216 tablet_bootstrap.cc:654] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:58.322646 6800 tablet_service.cc:1467] Processing CreateTablet for tablet c5d7763c6afa45c699089e39d74a7816 (DEFAULT_TABLE table=test-table [id=58835c7c58c4451592469dad260a6087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:58.322907 7216 log.cc:824] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:58.323000 6800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5d7763c6afa45c699089e39d74a7816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:58.323251 7215 tablet_bootstrap.cc:492] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e: Bootstrap starting.
I20260812 06:23:58.323666 7216 tablet_bootstrap.cc:492] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3: No bootstrap required, opened a new log
I20260812 06:23:58.323735 7216 ts_tablet_manager.cc:1397] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:23:58.325675 7216 raft_consensus.cc:348] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3adfebd6012b4154b4e81c9bb129499e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43925 } } peers { permanent_uuid: "1852755b20314c6ba8aee01585915ba3" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 41785 } } peers { permanent_uuid: "daab7c208ad14ef8995bd128b13e47d6" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45905 } }
I20260812 06:23:58.325851 7216 raft_consensus.cc:374] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:58.325898 7216 raft_consensus.cc:729] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1852755b20314c6ba8aee01585915ba3, State: Initialized, Role: FOLLOWER
I20260812 06:23:58.326012 7216 consensus_queue.cc:260] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3adfebd6012b4154b4e81c9bb129499e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43925 } } peers { permanent_uuid: "1852755b20314c6ba8aee01585915ba3" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 41785 } } peers { permanent_uuid: "daab7c208ad14ef8995bd128b13e47d6" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45905 } }
I20260812 06:23:58.326274 7220 tablet_bootstrap.cc:492] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6: Bootstrap starting.
I20260812 06:23:58.326300 7216 ts_tablet_manager.cc:1428] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:23:58.326411 6658 heartbeater.cc:503] Master 127.30.15.126:38371 was elected leader, sending a full tablet report...
I20260812 06:23:58.326931 7215 tablet_bootstrap.cc:654] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:58.326936 7220 tablet_bootstrap.cc:654] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:58.327491 7215 log.cc:824] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:58.327549 7220 log.cc:824] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:58.328135 7215 tablet_bootstrap.cc:492] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e: No bootstrap required, opened a new log
I20260812 06:23:58.328195 7215 ts_tablet_manager.cc:1397] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 06:23:58.328200 7220 tablet_bootstrap.cc:492] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6: No bootstrap required, opened a new log
I20260812 06:23:58.328254 7220 ts_tablet_manager.cc:1397] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:23:58.329614 7215 raft_consensus.cc:348] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3adfebd6012b4154b4e81c9bb129499e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43925 } } peers { permanent_uuid: "1852755b20314c6ba8aee01585915ba3" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 41785 } } peers { permanent_uuid: "daab7c208ad14ef8995bd128b13e47d6" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45905 } }
I20260812 06:23:58.329731 7215 raft_consensus.cc:374] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:58.329761 7215 raft_consensus.cc:729] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3adfebd6012b4154b4e81c9bb129499e, State: Initialized, Role: FOLLOWER
I20260812 06:23:58.329862 7215 consensus_queue.cc:260] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3adfebd6012b4154b4e81c9bb129499e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43925 } } peers { permanent_uuid: "1852755b20314c6ba8aee01585915ba3" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 41785 } } peers { permanent_uuid: "daab7c208ad14ef8995bd128b13e47d6" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45905 } }
I20260812 06:23:58.329852 7220 raft_consensus.cc:348] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3adfebd6012b4154b4e81c9bb129499e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43925 } } peers { permanent_uuid: "1852755b20314c6ba8aee01585915ba3" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 41785 } } peers { permanent_uuid: "daab7c208ad14ef8995bd128b13e47d6" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45905 } }
I20260812 06:23:58.329964 7220 raft_consensus.cc:374] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:58.330004 7220 raft_consensus.cc:729] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daab7c208ad14ef8995bd128b13e47d6, State: Initialized, Role: FOLLOWER
I20260812 06:23:58.330113 7215 ts_tablet_manager.cc:1428] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:23:58.330137 7186 heartbeater.cc:503] Master 127.30.15.126:38371 was elected leader, sending a full tablet report...
I20260812 06:23:58.330137 7220 consensus_queue.cc:260] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3adfebd6012b4154b4e81c9bb129499e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43925 } } peers { permanent_uuid: "1852755b20314c6ba8aee01585915ba3" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 41785 } } peers { permanent_uuid: "daab7c208ad14ef8995bd128b13e47d6" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45905 } }
I20260812 06:23:58.330415 7220 ts_tablet_manager.cc:1428] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:23:58.330435 6914 heartbeater.cc:503] Master 127.30.15.126:38371 was elected leader, sending a full tablet report...
I20260812 06:23:58.333257 7221 raft_consensus.cc:482] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:23:58.333324 7221 raft_consensus.cc:504] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3adfebd6012b4154b4e81c9bb129499e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43925 } } peers { permanent_uuid: "1852755b20314c6ba8aee01585915ba3" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 41785 } } peers { permanent_uuid: "daab7c208ad14ef8995bd128b13e47d6" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45905 } }
I20260812 06:23:58.333559 7221 leader_election.cc:288] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3adfebd6012b4154b4e81c9bb129499e (127.30.15.67:43925), daab7c208ad14ef8995bd128b13e47d6 (127.30.15.66:45905)
I20260812 06:23:58.336228 6661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.333678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:43925 (local address 127.30.15.65:55131)
0812 06:23:58.333728 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.333738 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.333786 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.333938 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.333939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.333941 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:58.334001 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.334002 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.334638 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.334639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.335452 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.335455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.335996 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.335997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.336078 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.336081 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.336125 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.336164 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":21}
I20260812 06:23:58.336222 7207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.333706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:55131 (local address 127.30.15.67:43925)
0812 06:23:58.333738 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.333739 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.333773 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:23:58.333834 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.333835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.333843 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.333895 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:58.334071 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.334574 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.335527 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.335927 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.335988 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.335995 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.336136 (+ 141us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.336166 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:23:58.336324 7214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.333815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:56837 (local address 127.30.15.66:45905)
0812 06:23:58.333864 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.333866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.334028 (+ 162us) server_negotiation.cc:407] Connection header received
0812 06:23:58.334083 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.334084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.334092 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.334140 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:23:58.334249 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.334666 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.335685 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.336039 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.336098 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.336105 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.336239 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.336270 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:23:58.336337 7232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.333772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:45905 (local address 127.30.15.65:56837)
0812 06:23:58.333948 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.333985 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.334036 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.334140 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.334141 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.334142 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:23:58.334196 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.334197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.334738 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.334740 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.335595 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:58.335598 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.336106 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.336107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:58.336181 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.336184 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.336228 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.336264 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":80,"threads_started":1}
I20260812 06:23:58.336542 6835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5d7763c6afa45c699089e39d74a7816" candidate_uuid: "1852755b20314c6ba8aee01585915ba3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daab7c208ad14ef8995bd128b13e47d6" is_pre_election: true
I20260812 06:23:58.336557 7097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5d7763c6afa45c699089e39d74a7816" candidate_uuid: "1852755b20314c6ba8aee01585915ba3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3adfebd6012b4154b4e81c9bb129499e" is_pre_election: true
I20260812 06:23:58.336643 6835 raft_consensus.cc:2454] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1852755b20314c6ba8aee01585915ba3 in term 0.
I20260812 06:23:58.336664 7097 raft_consensus.cc:2454] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1852755b20314c6ba8aee01585915ba3 in term 0.
I20260812 06:23:58.336833 6433 leader_election.cc:302] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1852755b20314c6ba8aee01585915ba3, 3adfebd6012b4154b4e81c9bb129499e; no voters:
I20260812 06:23:58.336941 7221 raft_consensus.cc:2781] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:23:58.337000 7221 raft_consensus.cc:482] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:23:58.337023 7221 raft_consensus.cc:3037] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:58.337592 7221 raft_consensus.cc:504] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3adfebd6012b4154b4e81c9bb129499e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43925 } } peers { permanent_uuid: "1852755b20314c6ba8aee01585915ba3" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 41785 } } peers { permanent_uuid: "daab7c208ad14ef8995bd128b13e47d6" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45905 } }
I20260812 06:23:58.337697 7221 leader_election.cc:288] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [CANDIDATE]: Term 1 election: Requested vote from peers 3adfebd6012b4154b4e81c9bb129499e (127.30.15.67:43925), daab7c208ad14ef8995bd128b13e47d6 (127.30.15.66:45905)
I20260812 06:23:58.337858 7097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5d7763c6afa45c699089e39d74a7816" candidate_uuid: "1852755b20314c6ba8aee01585915ba3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3adfebd6012b4154b4e81c9bb129499e"
I20260812 06:23:58.337857 6835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5d7763c6afa45c699089e39d74a7816" candidate_uuid: "1852755b20314c6ba8aee01585915ba3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daab7c208ad14ef8995bd128b13e47d6"
I20260812 06:23:58.337919 7097 raft_consensus.cc:3037] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:58.337921 6835 raft_consensus.cc:3037] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:58.338505 7097 raft_consensus.cc:2454] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1852755b20314c6ba8aee01585915ba3 in term 1.
I20260812 06:23:58.338546 6835 raft_consensus.cc:2454] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1852755b20314c6ba8aee01585915ba3 in term 1.
I20260812 06:23:58.338658 6433 leader_election.cc:302] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1852755b20314c6ba8aee01585915ba3, 3adfebd6012b4154b4e81c9bb129499e; no voters:
I20260812 06:23:58.338758 7221 raft_consensus.cc:2781] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:58.338882 7221 raft_consensus.cc:686] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [term 1 LEADER]: Becoming Leader. State: Replica: 1852755b20314c6ba8aee01585915ba3, State: Running, Role: LEADER
I20260812 06:23:58.338958 7221 consensus_queue.cc:237] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3adfebd6012b4154b4e81c9bb129499e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43925 } } peers { permanent_uuid: "1852755b20314c6ba8aee01585915ba3" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 41785 } } peers { permanent_uuid: "daab7c208ad14ef8995bd128b13e47d6" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45905 } }
I20260812 06:23:58.339617 6274 catalog_manager.cc:5495] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1852755b20314c6ba8aee01585915ba3 (127.30.15.65). New cstate: current_term: 1 leader_uuid: "1852755b20314c6ba8aee01585915ba3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3adfebd6012b4154b4e81c9bb129499e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1852755b20314c6ba8aee01585915ba3" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "daab7c208ad14ef8995bd128b13e47d6" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45905 } health_report { overall_health: UNKNOWN } } }
I20260812 06:23:58.343959 7212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.341804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59062 (local address 127.30.15.65:41785)
0812 06:23:58.341844 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.341846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.341854 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:23:58.341927 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.341928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.341943 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.342043 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:23:58.342156 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.342574 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.343257 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:58.343469 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:58.343523 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:58.343684 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:23:58.343762 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:23:58.343825 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.343867 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.343884 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:23:58.345346 6835 raft_consensus.cc:1261] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6 [term 1 FOLLOWER]: Refusing update from remote peer 1852755b20314c6ba8aee01585915ba3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:58.345363 7097 raft_consensus.cc:1261] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e [term 1 FOLLOWER]: Refusing update from remote peer 1852755b20314c6ba8aee01585915ba3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:58.345641 7221 consensus_queue.cc:1035] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3adfebd6012b4154b4e81c9bb129499e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:58.345772 7234 consensus_queue.cc:1035] T c5d7763c6afa45c699089e39d74a7816 P 1852755b20314c6ba8aee01585915ba3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "daab7c208ad14ef8995bd128b13e47d6" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:58.347736 7237 mvcc.cc:205] Tried to move back new op lower bound from 7317568873860542464 to 7317568873836896256. Current Snapshot: MvccSnapshot[applied={T|T < 7317568873860542464}]
I20260812 06:23:58.349807 6274 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:58.349875 6274 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:58.350442 6274 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fde7f97737d54aa4bc0cfd40ba3cc96f: Sending DeleteTablet for 3 replicas of tablet c5d7763c6afa45c699089e39d74a7816
I20260812 06:23:58.350751 7056 tablet_service.cc:1514] Processing DeleteTablet for tablet c5d7763c6afa45c699089e39d74a7816 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:58 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:56172
I20260812 06:23:58.350776 6519 tablet_service.cc:1514] Processing DeleteTablet for tablet c5d7763c6afa45c699089e39d74a7816 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:58 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:59046
I20260812 06:23:58.350795 6800 tablet_service.cc:1514] Processing DeleteTablet for tablet c5d7763c6afa45c699089e39d74a7816 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:58 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:45212
I20260812 06:23:58.351011 7256 tablet_replica.cc:330] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6: stopping tablet replica
I20260812 06:23:58.351127 7254 tablet_replica.cc:330] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e: stopping tablet replica
I20260812 06:23:58.351202 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 6403
I20260812 06:23:58.351217 7254 raft_consensus.cc:2229] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:58.383323 7256 raft_consensus.cc:2229] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:58.383461 7256 raft_consensus.cc:2258] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:58.384943 7254 raft_consensus.cc:2258] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:58.385025 7256 ts_tablet_manager.cc:1905] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:58.386596 7256 ts_tablet_manager.cc:1918] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:23:58.386670 7256 log.cc:1196] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/c5d7763c6afa45c699089e39d74a7816
I20260812 06:23:58.386937 7256 ts_tablet_manager.cc:1939] T c5d7763c6afa45c699089e39d74a7816 P daab7c208ad14ef8995bd128b13e47d6: Deleting consensus metadata
I20260812 06:23:58.387363 6237 catalog_manager.cc:4841] TS daab7c208ad14ef8995bd128b13e47d6 (127.30.15.66:45905): tablet c5d7763c6afa45c699089e39d74a7816 (table test-table [id=58835c7c58c4451592469dad260a6087]) successfully deleted
I20260812 06:23:58.389777 7254 ts_tablet_manager.cc:1905] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 06:23:58.389923 6237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:41785 (error 108)
I20260812 06:23:58.390144 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 6665
I20260812 06:23:58.390355 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.390226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:41785 (local address 127.0.0.1:59068)
0812 06:23:58.390274 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.390322 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:41785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260812 06:23:58.392812 7254 ts_tablet_manager.cc:1918] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:23:58.392864 7254 log.cc:1196] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/c5d7763c6afa45c699089e39d74a7816
I20260812 06:23:58.393039 7254 ts_tablet_manager.cc:1939] T c5d7763c6afa45c699089e39d74a7816 P 3adfebd6012b4154b4e81c9bb129499e: Deleting consensus metadata
W20260812 06:23:58.396174 6237 catalog_manager.cc:4584] TS 1852755b20314c6ba8aee01585915ba3 (127.30.15.65:41785): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c5d7763c6afa45c699089e39d74a7816: Network error: Client connection negotiation failed: client connection to 127.30.15.65:41785: connect: Connection refused (error 111)
I20260812 06:23:58.396278 6237 catalog_manager.cc:4841] TS 3adfebd6012b4154b4e81c9bb129499e (127.30.15.67:43925): tablet c5d7763c6afa45c699089e39d74a7816 (table test-table [id=58835c7c58c4451592469dad260a6087]) successfully deleted
I20260812 06:23:58.407883 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 6929
I20260812 06:23:58.417181 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 6206
2026-08-12T06:23:58Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2027 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T06:23:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:58Z Disabled control of system clock
I20260812 06:23:58.448617 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:34621
--webserver_interface=127.30.15.126
--webserver_port=0
--builtin_ntp_servers=127.30.15.84:39501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:34621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 06:23:58.527206 7262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:58.527395 7262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:58.527415 7262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:58.528460 7262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:58.528493 7262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:58.528504 7262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:58.528514 7262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:58.528538 7262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:23:58.529781 7262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:34621
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:34621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:58.529949 7262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:58.530165 7262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:58.534425 7276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:58.534416 7275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:58.534507 7278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:58.534585 7262 server_base.cc:1034] running on GCE node
I20260812 06:23:58.534783 7262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:58.535055 7262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:58.536191 7262 hybrid_clock.cc:648] HybridClock initialized: now 1786515838536177 us; error 28 us; skew 500 ppm
I20260812 06:23:58.537277 7262 webserver.cc:460] Webserver started at http://127.30.15.126:36337/ using document root <none> and password file <none>
I20260812 06:23:58.537498 7262 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:58.537544 7262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:58.537663 7262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:58.538587 7262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "1a9fdff411ad459b9fbf8547e15da786"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "6c9d57da539579cbfbfc07dddfd47c87"
server_key_iv: "74a74e38dd10f00caf5389e5565e2202"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.538893 7262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "1a9fdff411ad459b9fbf8547e15da786"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "6c9d57da539579cbfbfc07dddfd47c87"
server_key_iv: "74a74e38dd10f00caf5389e5565e2202"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.540107 7262 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:23:58.540741 7287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.540879 7262 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:58.540954 7262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "1a9fdff411ad459b9fbf8547e15da786"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "6c9d57da539579cbfbfc07dddfd47c87"
server_key_iv: "74a74e38dd10f00caf5389e5565e2202"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.541014 7262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:58.544135 7262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:58.544356 7262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:58.544478 7262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:58.548166 7262 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:34621
I20260812 06:23:58.548203 7392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:34621 every 8 connection(s)
I20260812 06:23:58.548513 7262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:58.549099 7393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:58.551592 7393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786: Bootstrap starting.
I20260812 06:23:58.552102 7393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:58.552337 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 7262
I20260812 06:23:58.552374 7393 log.cc:824] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:58.552429 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:58.552629 30781 external_mini_cluster.cc:1428] Setting key 46b77df079bf53e1d1d62df7f5fe56ad
I20260812 06:23:58.553105 7393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786: No bootstrap required, opened a new log
I20260812 06:23:58.555065 7393 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a9fdff411ad459b9fbf8547e15da786" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34621 } }
I20260812 06:23:58.555219 7393 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:58.555282 7393 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a9fdff411ad459b9fbf8547e15da786, State: Initialized, Role: FOLLOWER
I20260812 06:23:58.555404 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.553077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34582 (local address 127.30.15.126:34621)
0812 06:23:58.553285 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.553293 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.553325 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:23:58.554214 (+ 889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.554223 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.554270 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.554405 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:58.554963 (+ 558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:58.554966 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:58.554967 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:58.554972 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:58.555016 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:58.555031 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:58.555104 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.555137 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.555188 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":82,"threads_started":1}
I20260812 06:23:58.555413 7393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a9fdff411ad459b9fbf8547e15da786" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34621 } }
I20260812 06:23:58.555534 7393 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:58.555572 7393 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:58.555616 7393 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:58.556397 7393 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a9fdff411ad459b9fbf8547e15da786" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34621 } }
I20260812 06:23:58.556491 7393 leader_election.cc:302] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a9fdff411ad459b9fbf8547e15da786; no voters:
I20260812 06:23:58.556602 7393 leader_election.cc:288] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:58.556653 7406 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:58.556797 7406 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [term 1 LEADER]: Becoming Leader. State: Replica: 1a9fdff411ad459b9fbf8547e15da786, State: Running, Role: LEADER
I20260812 06:23:58.556820 7393 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:58.556885 7406 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a9fdff411ad459b9fbf8547e15da786" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34621 } }
I20260812 06:23:58.557281 7407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a9fdff411ad459b9fbf8547e15da786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a9fdff411ad459b9fbf8547e15da786" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34621 } } }
I20260812 06:23:58.557397 7407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:58.557281 7408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a9fdff411ad459b9fbf8547e15da786. Latest consensus state: current_term: 1 leader_uuid: "1a9fdff411ad459b9fbf8547e15da786" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a9fdff411ad459b9fbf8547e15da786" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34621 } } }
I20260812 06:23:58.557500 7408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:58.557628 7419 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:58.558089 7419 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:58.559548 7419 catalog_manager.cc:1347] Generated new cluster ID: 14d16df24af94cdbad427493941bc797
I20260812 06:23:58.559589 7419 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:23:58.578215 7419 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:58.578349 7419 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:58.582593 7419 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786: Generated new TSK 0
I20260812 06:23:58.582739 7419 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:23:58.588454 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34621
--builtin_ntp_servers=127.30.15.84:39501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 06:23:58.683306 7441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:58.683482 7441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:58.683502 7441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:58.684649 7441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:58.684687 7441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:58.684711 7441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:23:58.686012 7441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:58.686223 7441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:58.686496 7441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:58.691126 7448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:58.691134 7447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:58.691318 7441 server_base.cc:1034] running on GCE node
W20260812 06:23:58.691395 7450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:58.691687 7441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:58.691967 7441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:58.693152 7441 hybrid_clock.cc:648] HybridClock initialized: now 1786515838693131 us; error 44 us; skew 500 ppm
I20260812 06:23:58.694285 7441 webserver.cc:460] Webserver started at http://127.30.15.65:35801/ using document root <none> and password file <none>
I20260812 06:23:58.694499 7441 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:58.694551 7441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:58.694689 7441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:58.695724 7441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "9f5f3590e3924fecba3b36eac89bd6ee"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "de366f85adbfda705cf2cef48c9a1bb7"
server_key_iv: "d05bf6607f3a5556020182e9ad470192"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.696038 7441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "9f5f3590e3924fecba3b36eac89bd6ee"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "de366f85adbfda705cf2cef48c9a1bb7"
server_key_iv: "d05bf6607f3a5556020182e9ad470192"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.697219 7441 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:23:58.697854 7463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.698000 7441 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:58.698078 7441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "9f5f3590e3924fecba3b36eac89bd6ee"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "de366f85adbfda705cf2cef48c9a1bb7"
server_key_iv: "d05bf6607f3a5556020182e9ad470192"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.698139 7441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:58.701360 7441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:58.701581 7441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:58.701701 7441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:58.701887 7441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:58.702162 7441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:58.702193 7441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.702219 7441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:58.702243 7441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.707660 7441 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:38851
I20260812 06:23:58.707718 7727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:38851 every 8 connection(s)
I20260812 06:23:58.707962 7441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:23:58.710651 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.708567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:44547 (local address 127.30.15.126:34621)
0812 06:23:58.708618 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.708620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.708816 (+ 196us) server_negotiation.cc:407] Connection header received
0812 06:23:58.709285 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.709286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.709293 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.709342 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:58.710411 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:58.710412 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:58.710413 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:58.710417 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:58.710435 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:58.710446 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:58.710494 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.710569 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.710583 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:23:58.710812 7731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.708549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:34621 (local address 127.30.15.65:44547)
0812 06:23:58.708716 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.708745 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.709190 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.709405 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.709408 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.709418 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:58.710267 (+ 849us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:23:58.710268 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:58.710293 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:23:58.710320 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:58.710498 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:58.710503 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:58.710506 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.710574 (+ 68us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.710632 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
I20260812 06:23:58.711220 7728 heartbeater.cc:347] Connected to a master server at 127.30.15.126:34621
I20260812 06:23:58.711323 7728 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:58.711447 7728 heartbeater.cc:511] Master 127.30.15.126:34621 requested a full tablet report, sending...
I20260812 06:23:58.711860 7321 ts_manager.cc:194] Registered new tserver with Master: 9f5f3590e3924fecba3b36eac89bd6ee (127.30.15.65:38851)
I20260812 06:23:58.714090 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 7441
I20260812 06:23:58.714169 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:23:58.714313 30781 external_mini_cluster.cc:1428] Setting key f41c45af8795f05a76d8e4dea6b0319d
I20260812 06:23:58.715099 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34621
--builtin_ntp_servers=127.30.15.84:39501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 06:23:58.795015 7732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:58.795193 7732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:58.795213 7732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:58.796334 7732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:58.796372 7732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:58.796396 7732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:23:58.797673 7732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:58.797883 7732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:58.798141 7732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:58.802717 7742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:58.802794 7746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:58.802832 7732 server_base.cc:1034] running on GCE node
W20260812 06:23:58.802706 7743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:58.803067 7732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:58.803280 7732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:58.804426 7732 hybrid_clock.cc:648] HybridClock initialized: now 1786515838804408 us; error 31 us; skew 500 ppm
I20260812 06:23:58.805555 7732 webserver.cc:460] Webserver started at http://127.30.15.66:43591/ using document root <none> and password file <none>
I20260812 06:23:58.805770 7732 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:58.805817 7732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:58.805938 7732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:58.806876 7732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "c2ef89bb981a42eb992b4111ea71905f"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "e714da088ead44ede10cd6280c298511"
server_key_iv: "789118acc14cec61697f77a33b1c435a"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.807183 7732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "c2ef89bb981a42eb992b4111ea71905f"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "e714da088ead44ede10cd6280c298511"
server_key_iv: "789118acc14cec61697f77a33b1c435a"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.808375 7732 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:23:58.809015 7758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.809162 7732 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:58.809240 7732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "c2ef89bb981a42eb992b4111ea71905f"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "e714da088ead44ede10cd6280c298511"
server_key_iv: "789118acc14cec61697f77a33b1c435a"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.809298 7732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:58.812376 7732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:58.812597 7732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:58.812707 7732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:58.812875 7732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:58.813140 7732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:58.813172 7732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.813197 7732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:58.813220 7732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.818488 7732 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:41441
I20260812 06:23:58.818547 7969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:41441 every 8 connection(s)
I20260812 06:23:58.818792 7732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:23:58.819727 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 7732
I20260812 06:23:58.819801 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:23:58.819953 30781 external_mini_cluster.cc:1428] Setting key cd3ef022a4876ec7cb26fc022603af3b
I20260812 06:23:58.820780 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34621
--builtin_ntp_servers=127.30.15.84:39501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 06:23:58.821512 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.819378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:48245 (local address 127.30.15.126:34621)
0812 06:23:58.819422 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.819424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.819676 (+ 252us) server_negotiation.cc:407] Connection header received
0812 06:23:58.820137 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.820138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.820145 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.820194 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:58.821283 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:58.821284 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:58.821285 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:58.821289 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:58.821305 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:58.821309 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:58.821358 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.821429 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.821442 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:23:58.821695 7979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.819391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:34621 (local address 127.30.15.66:48245)
0812 06:23:58.819566 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.819600 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.820024 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.820257 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.820261 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.820270 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:58.821147 (+ 877us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:23:58.821148 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:58.821173 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:23:58.821200 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:58.821363 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:58.821368 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:58.821371 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.821438 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.821495 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":95,"threads_started":1}
I20260812 06:23:58.822144 7970 heartbeater.cc:347] Connected to a master server at 127.30.15.126:34621
I20260812 06:23:58.822245 7970 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:58.822386 7970 heartbeater.cc:511] Master 127.30.15.126:34621 requested a full tablet report, sending...
I20260812 06:23:58.822737 7321 ts_manager.cc:194] Registered new tserver with Master: c2ef89bb981a42eb992b4111ea71905f (127.30.15.66:41441)
W20260812 06:23:58.900183 7980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:58.900362 7980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:58.900391 7980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:58.901571 7980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:58.901609 7980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:58.901643 7980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:23:58.902943 7980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:58.903163 7980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:58.903431 7980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:58.907913 7986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:58.907920 7991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:58.908139 7980 server_base.cc:1034] running on GCE node
W20260812 06:23:58.907918 7987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:58.908388 7980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:58.908625 7980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:58.909755 7980 hybrid_clock.cc:648] HybridClock initialized: now 1786515838909746 us; error 26 us; skew 500 ppm
I20260812 06:23:58.910851 7980 webserver.cc:460] Webserver started at http://127.30.15.67:40905/ using document root <none> and password file <none>
I20260812 06:23:58.911083 7980 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:58.911132 7980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:58.911253 7980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:58.912295 7980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "5e491686c9f746a08b117921d7f918f6"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "bc66040bf0d7afb9ea07049b17dfc1c2"
server_key_iv: "92cc5cf40451d22216c5d101e5adbc56"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.912653 7980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "5e491686c9f746a08b117921d7f918f6"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "bc66040bf0d7afb9ea07049b17dfc1c2"
server_key_iv: "92cc5cf40451d22216c5d101e5adbc56"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.913741 7980 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:23:58.914361 8006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.914490 7980 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:58.914557 7980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "5e491686c9f746a08b117921d7f918f6"
format_stamp: "Formatted at 2026-08-12 06:23:58 on dist-test-slave-gjrz"
server_key: "bc66040bf0d7afb9ea07049b17dfc1c2"
server_key_iv: "92cc5cf40451d22216c5d101e5adbc56"
server_key_version: "encryptionkey@0"
I20260812 06:23:58.914623 7980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:58.917812 7980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:58.918033 7980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:58.918139 7980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:58.918334 7980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:23:58.918609 7980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:23:58.918640 7980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.918668 7980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:23:58.918689 7980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:58.924063 7980 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:46765
I20260812 06:23:58.924122 8246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:46765 every 8 connection(s)
I20260812 06:23:58.924374 7980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:23:58.925716 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 7980
I20260812 06:23:58.925814 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:23:58.925966 30781 external_mini_cluster.cc:1428] Setting key 964c2e21dafd8593c02d2eb13df5ebe8
I20260812 06:23:58.927096 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.925005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:48929 (local address 127.30.15.126:34621)
0812 06:23:58.925059 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.925061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.925242 (+ 181us) server_negotiation.cc:407] Connection header received
0812 06:23:58.925678 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.925680 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.925687 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.925737 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:58.926917 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:58.926918 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:58.926919 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:58.926922 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:58.926937 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:58.926941 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:58.926990 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.927035 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.927045 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:23:58.927299 8253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.924967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:34621 (local address 127.30.15.67:48929)
0812 06:23:58.925147 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.925175 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.925587 (+ 412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.925799 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.925803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.925813 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:58.926781 (+ 968us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:23:58.926781 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:58.926816 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:23:58.926845 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:58.926991 (+ 146us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:58.926994 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:58.926996 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.927040 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.927082 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":89,"threads_started":1}
I20260812 06:23:58.927714 8249 heartbeater.cc:347] Connected to a master server at 127.30.15.126:34621
I20260812 06:23:58.927784 8249 heartbeater.cc:464] Registering TS with master...
I20260812 06:23:58.927914 8249 heartbeater.cc:511] Master 127.30.15.126:34621 requested a full tablet report, sending...
I20260812 06:23:58.928233 7321 ts_manager.cc:194] Registered new tserver with Master: 5e491686c9f746a08b117921d7f918f6 (127.30.15.67:46765)
I20260812 06:23:58.937444 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:23:58.939540 7405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.938635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34592 (local address 127.30.15.126:34621)
0812 06:23:58.938692 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.938694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.938775 (+ 81us) server_negotiation.cc:407] Connection header received
0812 06:23:58.938836 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.938837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.938841 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.938886 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:58.939359 (+ 473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:58.939360 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:58.939361 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:58.939364 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:58.939376 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:58.939380 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:58.939422 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.939469 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.939481 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:23:58.940912 7321 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34592:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:23:58.942407 7321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:23:58.945816 8268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.944257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:38851 (local address 127.0.0.1:56006)
0812 06:23:58.944578 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.944618 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.944683 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.944829 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.944833 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.944839 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:58.945259 (+ 420us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:23:58.945260 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:58.945273 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:23:58.945293 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:58.945659 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:58.945666 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:58.945668 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.945735 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.945747 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":82,"threads_started":1}
I20260812 06:23:58.945875 8274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.944337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56006 (local address 127.30.15.65:38851)
0812 06:23:58.944481 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.944485 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.944698 (+ 213us) server_negotiation.cc:407] Connection header received
0812 06:23:58.944733 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.944736 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.944747 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.944829 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:58.945360 (+ 531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:58.945495 (+ 135us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:58.945496 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:58.945502 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:58.945543 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:58.945569 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:58.945631 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.945767 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.945785 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
I20260812 06:23:58.945963 8278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.944658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41926 (local address 127.30.15.66:41441)
0812 06:23:58.944822 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.944827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.944898 (+ 71us) server_negotiation.cc:407] Connection header received
0812 06:23:58.944948 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.944951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.944967 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.945336 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:58.945613 (+ 277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:58.945617 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:58.945617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:58.945621 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:58.945647 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:58.945662 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:58.945715 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.945848 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.945865 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
I20260812 06:23:58.946349 8272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.944437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:41441 (local address 127.0.0.1:41926)
0812 06:23:58.944849 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.944858 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.944901 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.945060 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.945061 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.945063 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:58.945516 (+ 453us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:23:58.945516 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:58.945521 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:23:58.945531 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:58.945739 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:58.945740 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:58.945740 (+ 0us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.945780 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.945789 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":85,"threads_started":1}
I20260812 06:23:58.946404 8276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.944413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57534 (local address 127.30.15.67:46765)
0812 06:23:58.944587 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:58.944590 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:58.945140 (+ 550us) server_negotiation.cc:407] Connection header received
0812 06:23:58.945165 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:58.945167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:58.945175 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:58.945244 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:58.946096 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:58.946104 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:58.946104 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:58.946108 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:58.946143 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:58.946162 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:58.946215 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:58.946334 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 06:23:58.946348 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":86,"threads_started":1}
I20260812 06:23:58.946605 8277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:58.944256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:46765 (local address 127.0.0.1:57534)
0812 06:23:58.944575 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:58.944619 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:58.944681 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:58.945480 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:58.945481 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:58.945483 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:58.946014 (+ 531us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:23:58.946015 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:58.946022 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:23:58.946034 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:58.946217 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:58.946218 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:58.946219 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:23:58.946261 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 06:23:58.946273 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":59,"threads_started":1}
I20260812 06:23:58.946648 7582 tablet_service.cc:1467] Processing CreateTablet for tablet 07011fb4e47e49139fd7628f6b3f019e (DEFAULT_TABLE table=test-table [id=fba158bb38344d3abdf959d4b2a4b855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:58.947052 7582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07011fb4e47e49139fd7628f6b3f019e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:58.947094 7852 tablet_service.cc:1467] Processing CreateTablet for tablet 07011fb4e47e49139fd7628f6b3f019e (DEFAULT_TABLE table=test-table [id=fba158bb38344d3abdf959d4b2a4b855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:58.947172 8099 tablet_service.cc:1467] Processing CreateTablet for tablet 07011fb4e47e49139fd7628f6b3f019e (DEFAULT_TABLE table=test-table [id=fba158bb38344d3abdf959d4b2a4b855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:23:58.947455 8099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07011fb4e47e49139fd7628f6b3f019e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:58.947458 7852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07011fb4e47e49139fd7628f6b3f019e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:58.949421 8282 tablet_bootstrap.cc:492] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee: Bootstrap starting.
I20260812 06:23:58.950030 8282 tablet_bootstrap.cc:654] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:58.950268 8282 log.cc:824] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:58.950498 8283 tablet_bootstrap.cc:492] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6: Bootstrap starting.
I20260812 06:23:58.951081 8283 tablet_bootstrap.cc:654] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:58.951117 8282 tablet_bootstrap.cc:492] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee: No bootstrap required, opened a new log
I20260812 06:23:58.951172 8282 ts_tablet_manager.cc:1397] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:23:58.951401 8284 tablet_bootstrap.cc:492] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f: Bootstrap starting.
I20260812 06:23:58.951438 8283 log.cc:824] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:58.952004 8284 tablet_bootstrap.cc:654] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:58.952324 8284 log.cc:824] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:58.952385 8283 tablet_bootstrap.cc:492] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6: No bootstrap required, opened a new log
I20260812 06:23:58.952450 8283 ts_tablet_manager.cc:1397] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:23:58.953833 8282 raft_consensus.cc:348] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e491686c9f746a08b117921d7f918f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46765 } } peers { permanent_uuid: "9f5f3590e3924fecba3b36eac89bd6ee" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38851 } } peers { permanent_uuid: "c2ef89bb981a42eb992b4111ea71905f" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41441 } }
I20260812 06:23:58.954021 8282 raft_consensus.cc:374] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:58.954082 8282 raft_consensus.cc:729] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5f3590e3924fecba3b36eac89bd6ee, State: Initialized, Role: FOLLOWER
I20260812 06:23:58.954200 8282 consensus_queue.cc:260] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e491686c9f746a08b117921d7f918f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46765 } } peers { permanent_uuid: "9f5f3590e3924fecba3b36eac89bd6ee" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38851 } } peers { permanent_uuid: "c2ef89bb981a42eb992b4111ea71905f" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41441 } }
I20260812 06:23:58.954504 8282 ts_tablet_manager.cc:1428] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260812 06:23:58.954517 7728 heartbeater.cc:503] Master 127.30.15.126:34621 was elected leader, sending a full tablet report...
I20260812 06:23:58.955050 8283 raft_consensus.cc:348] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e491686c9f746a08b117921d7f918f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46765 } } peers { permanent_uuid: "9f5f3590e3924fecba3b36eac89bd6ee" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38851 } } peers { permanent_uuid: "c2ef89bb981a42eb992b4111ea71905f" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41441 } }
I20260812 06:23:58.955189 8284 tablet_bootstrap.cc:492] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f: No bootstrap required, opened a new log
I20260812 06:23:58.955200 8283 raft_consensus.cc:374] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:58.955245 8284 ts_tablet_manager.cc:1397] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 06:23:58.955245 8283 raft_consensus.cc:729] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e491686c9f746a08b117921d7f918f6, State: Initialized, Role: FOLLOWER
I20260812 06:23:58.955381 8283 consensus_queue.cc:260] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e491686c9f746a08b117921d7f918f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46765 } } peers { permanent_uuid: "9f5f3590e3924fecba3b36eac89bd6ee" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38851 } } peers { permanent_uuid: "c2ef89bb981a42eb992b4111ea71905f" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41441 } }
I20260812 06:23:58.955653 8283 ts_tablet_manager.cc:1428] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260812 06:23:58.955735 8249 heartbeater.cc:503] Master 127.30.15.126:34621 was elected leader, sending a full tablet report...
I20260812 06:23:58.957526 8284 raft_consensus.cc:348] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e491686c9f746a08b117921d7f918f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46765 } } peers { permanent_uuid: "9f5f3590e3924fecba3b36eac89bd6ee" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38851 } } peers { permanent_uuid: "c2ef89bb981a42eb992b4111ea71905f" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41441 } }
I20260812 06:23:58.957688 8284 raft_consensus.cc:374] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:58.957726 8284 raft_consensus.cc:729] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ef89bb981a42eb992b4111ea71905f, State: Initialized, Role: FOLLOWER
I20260812 06:23:58.957832 8284 consensus_queue.cc:260] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e491686c9f746a08b117921d7f918f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46765 } } peers { permanent_uuid: "9f5f3590e3924fecba3b36eac89bd6ee" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38851 } } peers { permanent_uuid: "c2ef89bb981a42eb992b4111ea71905f" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41441 } }
I20260812 06:23:58.958060 8284 ts_tablet_manager.cc:1428] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:23:58.958113 7970 heartbeater.cc:503] Master 127.30.15.126:34621 was elected leader, sending a full tablet report...
W20260812 06:23:58.958396 7729 tablet.cc:2369] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:23:59.057871 8295 raft_consensus.cc:482] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:23:59.058001 8295 raft_consensus.cc:504] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e491686c9f746a08b117921d7f918f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46765 } } peers { permanent_uuid: "9f5f3590e3924fecba3b36eac89bd6ee" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38851 } } peers { permanent_uuid: "c2ef89bb981a42eb992b4111ea71905f" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41441 } }
I20260812 06:23:59.058370 8295 leader_election.cc:288] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5f3590e3924fecba3b36eac89bd6ee (127.30.15.65:38851), c2ef89bb981a42eb992b4111ea71905f (127.30.15.66:41441)
I20260812 06:23:59.059705 8253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.058540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:38851 (local address 127.30.15.67:59999)
0812 06:23:59.058594 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:59.058607 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:59.058648 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:59.058833 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:59.058834 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:59.058836 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:59.059210 (+ 374us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:23:59.059211 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:59.059218 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:23:59.059230 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:59.059588 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:59.059589 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:59.059590 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:23:59.059628 (+ 38us) client_negotiation.cc:240] Negotiation successful
0812 06:23:59.059640 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:23:59.059739 8274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.058633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:59999 (local address 127.30.15.65:38851)
0812 06:23:59.058728 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:59.058730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:59.058737 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:23:59.058762 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:59.058762 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:59.058767 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:59.058820 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:59.059324 (+ 504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:59.059326 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:59.059327 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:59.059332 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:59.059350 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:59.059355 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:59.059410 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:59.059646 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 06:23:59.059661 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 06:23:59.059964 8297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.058647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:41441 (local address 127.30.15.67:44051)
0812 06:23:59.058815 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:59.058825 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:59.058873 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:59.059206 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:59.059207 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:59.059210 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:23:59.059603 (+ 393us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:23:59.059604 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:23:59.059609 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:23:59.059621 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:23:59.059809 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:23:59.059809 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:23:59.059810 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:23:59.059877 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:23:59.059889 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":108,"threads_started":1}
I20260812 06:23:59.059959 8278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.058751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:44051 (local address 127.30.15.66:41441)
0812 06:23:59.058798 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:59.058800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:59.058879 (+ 79us) server_negotiation.cc:407] Connection header received
0812 06:23:59.058922 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:59.058923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:59.058929 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:59.058992 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:59.059702 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:59.059703 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:59.059703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:59.059707 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:59.059724 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:59.059729 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:59.059780 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:59.059884 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 06:23:59.059898 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:23:59.060017 7623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07011fb4e47e49139fd7628f6b3f019e" candidate_uuid: "5e491686c9f746a08b117921d7f918f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5f3590e3924fecba3b36eac89bd6ee" is_pre_election: true
I20260812 06:23:59.060153 7623 raft_consensus.cc:2454] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e491686c9f746a08b117921d7f918f6 in term 0.
I20260812 06:23:59.060294 7886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07011fb4e47e49139fd7628f6b3f019e" candidate_uuid: "5e491686c9f746a08b117921d7f918f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ef89bb981a42eb992b4111ea71905f" is_pre_election: true
I20260812 06:23:59.060392 8014 leader_election.cc:302] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e491686c9f746a08b117921d7f918f6, 9f5f3590e3924fecba3b36eac89bd6ee; no voters:
I20260812 06:23:59.060441 7886 raft_consensus.cc:2454] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e491686c9f746a08b117921d7f918f6 in term 0.
I20260812 06:23:59.060523 8295 raft_consensus.cc:2781] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:23:59.060575 8295 raft_consensus.cc:482] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:23:59.060606 8295 raft_consensus.cc:3037] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:59.061323 8295 raft_consensus.cc:504] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e491686c9f746a08b117921d7f918f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46765 } } peers { permanent_uuid: "9f5f3590e3924fecba3b36eac89bd6ee" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38851 } } peers { permanent_uuid: "c2ef89bb981a42eb992b4111ea71905f" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41441 } }
I20260812 06:23:59.061431 8295 leader_election.cc:288] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [CANDIDATE]: Term 1 election: Requested vote from peers 9f5f3590e3924fecba3b36eac89bd6ee (127.30.15.65:38851), c2ef89bb981a42eb992b4111ea71905f (127.30.15.66:41441)
I20260812 06:23:59.061573 7623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07011fb4e47e49139fd7628f6b3f019e" candidate_uuid: "5e491686c9f746a08b117921d7f918f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5f3590e3924fecba3b36eac89bd6ee"
I20260812 06:23:59.061582 7886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07011fb4e47e49139fd7628f6b3f019e" candidate_uuid: "5e491686c9f746a08b117921d7f918f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ef89bb981a42eb992b4111ea71905f"
I20260812 06:23:59.061646 7623 raft_consensus.cc:3037] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:59.061656 7886 raft_consensus.cc:3037] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:59.062340 7623 raft_consensus.cc:2454] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e491686c9f746a08b117921d7f918f6 in term 1.
I20260812 06:23:59.062418 7886 raft_consensus.cc:2454] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e491686c9f746a08b117921d7f918f6 in term 1.
I20260812 06:23:59.062515 8014 leader_election.cc:302] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e491686c9f746a08b117921d7f918f6, 9f5f3590e3924fecba3b36eac89bd6ee; no voters:
I20260812 06:23:59.062609 8295 raft_consensus.cc:2781] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:59.062754 8295 raft_consensus.cc:686] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 1 LEADER]: Becoming Leader. State: Replica: 5e491686c9f746a08b117921d7f918f6, State: Running, Role: LEADER
I20260812 06:23:59.062836 8295 consensus_queue.cc:237] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e491686c9f746a08b117921d7f918f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46765 } } peers { permanent_uuid: "9f5f3590e3924fecba3b36eac89bd6ee" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38851 } } peers { permanent_uuid: "c2ef89bb981a42eb992b4111ea71905f" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41441 } }
I20260812 06:23:59.063621 7321 catalog_manager.cc:5495] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e491686c9f746a08b117921d7f918f6 (127.30.15.67). New cstate: current_term: 1 leader_uuid: "5e491686c9f746a08b117921d7f918f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e491686c9f746a08b117921d7f918f6" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5f3590e3924fecba3b36eac89bd6ee" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2ef89bb981a42eb992b4111ea71905f" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41441 } health_report { overall_health: UNKNOWN } } }
W20260812 06:23:59.069249 7972 tablet.cc:2369] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:23:59.091952 8276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.091008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57540 (local address 127.30.15.67:46765)
0812 06:23:59.091076 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:59.091079 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:59.091099 (+ 20us) server_negotiation.cc:407] Connection header received
0812 06:23:59.091136 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:59.091137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:59.091150 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:59.091192 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:59.091741 (+ 549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:59.091743 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:59.091743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:59.091747 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:59.091764 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:59.091768 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:59.091814 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:59.091863 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 06:23:59.091876 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260812 06:23:59.093693 7886 raft_consensus.cc:1261] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f [term 1 FOLLOWER]: Refusing update from remote peer 5e491686c9f746a08b117921d7f918f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:59.093693 7623 raft_consensus.cc:1261] T 07011fb4e47e49139fd7628f6b3f019e P 9f5f3590e3924fecba3b36eac89bd6ee [term 1 FOLLOWER]: Refusing update from remote peer 5e491686c9f746a08b117921d7f918f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:23:59.094043 8299 consensus_queue.cc:1035] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ef89bb981a42eb992b4111ea71905f" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:59.094182 8295 consensus_queue.cc:1035] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5f3590e3924fecba3b36eac89bd6ee" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:23:59.097024 8307 mvcc.cc:205] Tried to move back new op lower bound from 7317568876925095936 to 7317568876802031616. Current Snapshot: MvccSnapshot[applied={T|T < 7317568876925095936 or (T in {7317568876925095936})}]
I20260812 06:23:59.098574 7320 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34592:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:59.098656 7320 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34592:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:23:59.099345 7320 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1a9fdff411ad459b9fbf8547e15da786: Sending DeleteTablet for 3 replicas of tablet 07011fb4e47e49139fd7628f6b3f019e
I20260812 06:23:59.099649 8099 tablet_service.cc:1514] Processing DeleteTablet for tablet 07011fb4e47e49139fd7628f6b3f019e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:59 UTC) from {username='slave'} at 127.0.0.1:57534
I20260812 06:23:59.099689 7582 tablet_service.cc:1514] Processing DeleteTablet for tablet 07011fb4e47e49139fd7628f6b3f019e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:59 UTC) from {username='slave'} at 127.0.0.1:56006
I20260812 06:23:59.099951 7852 tablet_service.cc:1514] Processing DeleteTablet for tablet 07011fb4e47e49139fd7628f6b3f019e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:23:59 UTC) from {username='slave'} at 127.0.0.1:41926
I20260812 06:23:59.099997 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 7441
I20260812 06:23:59.100544 8329 tablet_replica.cc:330] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f: stopping tablet replica
I20260812 06:23:59.100651 8329 raft_consensus.cc:2229] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:23:59.100761 8329 raft_consensus.cc:2258] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:59.105525 8329 ts_tablet_manager.cc:1905] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:59.106724 8325 tablet_replica.cc:330] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6: stopping tablet replica
I20260812 06:23:59.106822 8325 raft_consensus.cc:2229] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:23:59.106916 8325 raft_consensus.cc:2258] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:23:59.107075 8329 ts_tablet_manager.cc:1918] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:23:59.107138 8329 log.cc:1196] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/07011fb4e47e49139fd7628f6b3f019e
I20260812 06:23:59.107417 8329 ts_tablet_manager.cc:1939] T 07011fb4e47e49139fd7628f6b3f019e P c2ef89bb981a42eb992b4111ea71905f: Deleting consensus metadata
I20260812 06:23:59.107758 7289 catalog_manager.cc:4841] TS c2ef89bb981a42eb992b4111ea71905f (127.30.15.66:41441): tablet 07011fb4e47e49139fd7628f6b3f019e (table test-table [id=fba158bb38344d3abdf959d4b2a4b855]) successfully deleted
I20260812 06:23:59.108170 8325 ts_tablet_manager.cc:1905] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:23:59.110023 8325 ts_tablet_manager.cc:1918] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:23:59.110109 8325 log.cc:1196] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/07011fb4e47e49139fd7628f6b3f019e
I20260812 06:23:59.110426 8325 ts_tablet_manager.cc:1939] T 07011fb4e47e49139fd7628f6b3f019e P 5e491686c9f746a08b117921d7f918f6: Deleting consensus metadata
I20260812 06:23:59.110925 7291 catalog_manager.cc:4841] TS 5e491686c9f746a08b117921d7f918f6 (127.30.15.67:46765): tablet 07011fb4e47e49139fd7628f6b3f019e (table test-table [id=fba158bb38344d3abdf959d4b2a4b855]) successfully deleted
W20260812 06:23:59.120172 7289 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:38851 (error 108)
I20260812 06:23:59.120388 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 7732
I20260812 06:23:59.126053 8277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.120493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:38851 (local address 127.0.0.1:56018)
0812 06:23:59.125974 (+ 5481us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:59.126024 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5459}
W20260812 06:23:59.141965 7289 catalog_manager.cc:4584] TS 9f5f3590e3924fecba3b36eac89bd6ee (127.30.15.65:38851): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 07011fb4e47e49139fd7628f6b3f019e: Network error: Client connection negotiation failed: client connection to 127.30.15.65:38851: connect: Connection refused (error 111)
I20260812 06:23:59.154057 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 7980
I20260812 06:23:59.164152 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 7262
2026-08-12T06:23:59Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (745 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 06:23:59.186738 30781 mini_oidc.cc:152] Starting JWKS server
I20260812 06:23:59.191087 30781 webserver.cc:460] Webserver started at https://127.0.0.1:45267/ using document root <none> and password file <none>
I20260812 06:23:59.191191 30781 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 06:23:59.191394 30781 webserver.cc:460] Webserver started at http://127.0.0.1:46727/ using document root <none> and password file <none>
2026-08-12T06:23:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:59Z Disabled control of system clock
I20260812 06:23:59.199124 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:45623
--webserver_interface=127.30.15.126
--webserver_port=0
--builtin_ntp_servers=127.30.15.84:34407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:45623
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45267/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/testchainca.cert with env {}
W20260812 06:23:59.276933 8342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:59.277124 8342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:59.277153 8342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:59.278290 8342 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:59.278329 8342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:59.278345 8342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:59.278362 8342 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:59.278376 8342 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:23:59.278400 8342 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:23:59.278417 8342 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45267/jwks.json
I20260812 06:23:59.279968 8342 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:45623
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:45623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45267/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:59.280205 8342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:59.280385 8342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:23:59.284824 8342 server_base.cc:1034] running on GCE node
W20260812 06:23:59.284806 8350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:59.284808 8354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:59.284798 8351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:59.285220 8342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:59.285480 8342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:59.286607 8342 hybrid_clock.cc:648] HybridClock initialized: now 1786515839286598 us; error 27 us; skew 500 ppm
I20260812 06:23:59.287768 8342 webserver.cc:460] Webserver started at http://127.30.15.126:35797/ using document root <none> and password file <none>
I20260812 06:23:59.287982 8342 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:59.288043 8342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:59.288165 8342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:59.289106 8342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "d151a2ade24e46b18838995173057237"
format_stamp: "Formatted at 2026-08-12 06:23:59 on dist-test-slave-gjrz"
server_key: "80655b53c942fa016be6653e8562cf3d"
server_key_iv: "40b2098d8619a339a4061b74543ed6b7"
server_key_version: "encryptionkey@0"
I20260812 06:23:59.289418 8342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "d151a2ade24e46b18838995173057237"
format_stamp: "Formatted at 2026-08-12 06:23:59 on dist-test-slave-gjrz"
server_key: "80655b53c942fa016be6653e8562cf3d"
server_key_iv: "40b2098d8619a339a4061b74543ed6b7"
server_key_version: "encryptionkey@0"
I20260812 06:23:59.290586 8342 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:23:59.291328 8365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:59.292394 8342 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:23:59.292469 8342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "d151a2ade24e46b18838995173057237"
format_stamp: "Formatted at 2026-08-12 06:23:59 on dist-test-slave-gjrz"
server_key: "80655b53c942fa016be6653e8562cf3d"
server_key_iv: "40b2098d8619a339a4061b74543ed6b7"
server_key_version: "encryptionkey@0"
I20260812 06:23:59.292541 8342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:59.309762 8342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:59.310016 8342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:59.310137 8342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:59.313838 8342 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:45623
I20260812 06:23:59.313868 8490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:45623 every 8 connection(s)
I20260812 06:23:59.314162 8342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:59.315084 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:59.317190 8491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237: Bootstrap starting.
I20260812 06:23:59.317709 8491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:59.317938 8491 log.cc:824] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:59.318516 8491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237: No bootstrap required, opened a new log
I20260812 06:23:59.320062 8491 raft_consensus.cc:348] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d151a2ade24e46b18838995173057237" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45623 } }
I20260812 06:23:59.320188 8491 raft_consensus.cc:374] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:59.320209 8491 raft_consensus.cc:729] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d151a2ade24e46b18838995173057237, State: Initialized, Role: FOLLOWER
I20260812 06:23:59.320310 8491 consensus_queue.cc:260] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d151a2ade24e46b18838995173057237" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45623 } }
I20260812 06:23:59.320382 8491 raft_consensus.cc:388] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:59.320417 8491 raft_consensus.cc:482] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:59.320448 8491 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:59.320876 8491 raft_consensus.cc:504] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d151a2ade24e46b18838995173057237" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45623 } }
I20260812 06:23:59.320957 8491 leader_election.cc:302] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d151a2ade24e46b18838995173057237; no voters:
I20260812 06:23:59.321074 8491 leader_election.cc:288] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:59.321130 8495 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:59.321274 8491 sys_catalog.cc:564] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:59.321282 8495 raft_consensus.cc:686] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [term 1 LEADER]: Becoming Leader. State: Replica: d151a2ade24e46b18838995173057237, State: Running, Role: LEADER
I20260812 06:23:59.321398 8495 consensus_queue.cc:237] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d151a2ade24e46b18838995173057237" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45623 } }
I20260812 06:23:59.321775 8497 sys_catalog.cc:455] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d151a2ade24e46b18838995173057237. Latest consensus state: current_term: 1 leader_uuid: "d151a2ade24e46b18838995173057237" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d151a2ade24e46b18838995173057237" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45623 } } }
I20260812 06:23:59.321834 8496 sys_catalog.cc:455] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d151a2ade24e46b18838995173057237" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d151a2ade24e46b18838995173057237" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45623 } } }
I20260812 06:23:59.321885 8497 sys_catalog.cc:458] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:59.321923 8496 sys_catalog.cc:458] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:59.322089 8510 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:59.322604 8510 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:59.322892 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 8342
I20260812 06:23:59.322983 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:59.323158 30781 external_mini_cluster.cc:1428] Setting key aa4f7179e368d02b41cc4f14af48e517
I20260812 06:23:59.324573 8510 catalog_manager.cc:1347] Generated new cluster ID: 536a57ac272541888c6259e0489e725c
I20260812 06:23:59.324632 8510 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:23:59.327914 8534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.323601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54220 (local address 127.30.15.126:45623)
0812 06:23:59.323879 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:59.323886 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:59.323928 (+ 42us) server_negotiation.cc:407] Connection header received
0812 06:23:59.324010 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:59.324015 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:59.324064 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:59.324156 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:59.324427 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.325383 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.326161 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.326579 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.326683 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:59.327279 (+ 596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:59.327283 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:59.327283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:59.327446 (+ 163us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:59.327477 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:59.327487 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:59.327543 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:59.327613 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 06:23:59.327691 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":74,"threads_started":1}
I20260812 06:23:59.328711 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:23:59.341150 8510 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:59.341791 8510 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:59.347914 8510 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d151a2ade24e46b18838995173057237: Generated new TSK 0
I20260812 06:23:59.348062 8510 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 06:23:59.367842 8555 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 06:23:59.367911 8555 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 06:23:59.368181 8534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.353151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54236 (local address 127.30.15.126:45623)
0812 06:23:59.353193 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:59.353194 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:59.353289 (+ 95us) server_negotiation.cc:407] Connection header received
0812 06:23:59.353353 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:59.353354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:59.353365 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:59.353443 (+ 78us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:23:59.353547 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.354274 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.354972 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.355287 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.355347 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:59.355510 (+ 163us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:23:59.367985 (+ 12475us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45267/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 06:23:59.368115 (+ 130us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54236: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45267/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":23}
W20260812 06:23:59.368238 8534 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54236: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45267/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 06:23:59.368458 8554 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:23:59.353087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:45623 (local address 127.0.0.1:54236)
0812 06:23:59.353231 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:59.353239 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:59.353291 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:59.353443 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:59.353443 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:59.353445 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:23:59.353499 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:59.353500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.354346 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.354347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:59.354898 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:59.354899 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.355354 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.355354 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:59.355398 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:59.355418 (+ 20us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:23:59.368085 (+ 12667us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45267/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 06:23:59.368175 (+ 90us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.15.126:45623: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45267/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":70,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.30.15.126:45623: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45267/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 06:23:59.368816 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 8342
2026-08-12T06:23:59Z chronyd exiting
I20260812 06:23:59.418792 30781 test_util.cc:175] -----------------------------------------------
I20260812 06:23:59.418859 30781 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786515816548244-30781-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (233 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 06:23:59.419649 30781 mini_oidc.cc:152] Starting JWKS server
I20260812 06:23:59.420295 30781 webserver.cc:460] Webserver started at https://127.0.0.1:44359/ using document root <none> and password file <none>
I20260812 06:23:59.420334 30781 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 06:23:59.420462 30781 webserver.cc:460] Webserver started at http://127.0.0.1:42341/ using document root <none> and password file <none>
2026-08-12T06:23:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:59Z Disabled control of system clock
I20260812 06:23:59.428256 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:34605
--webserver_interface=127.30.15.126
--webserver_port=0
--builtin_ntp_servers=127.30.15.84:32835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:34605
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44359/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/testchainca.cert with env {}
W20260812 06:23:59.507812 8568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:59.507993 8568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:59.508023 8568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:59.509128 8568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:59.509167 8568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:59.509179 8568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:59.509191 8568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:59.509200 8568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:23:59.509215 8568 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:23:59.509238 8568 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44359/jwks.json
I20260812 06:23:59.510700 8568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:32835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:34605
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:34605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44359/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:59.510910 8568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:59.511094 8568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:59.515517 8581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:59.515532 8575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:59.515616 8584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:59.515666 8568 server_base.cc:1034] running on GCE node
I20260812 06:23:59.515879 8568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:59.516152 8568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:59.517297 8568 hybrid_clock.cc:648] HybridClock initialized: now 1786515839517282 us; error 28 us; skew 500 ppm
I20260812 06:23:59.518430 8568 webserver.cc:460] Webserver started at http://127.30.15.126:45019/ using document root <none> and password file <none>
I20260812 06:23:59.518630 8568 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:59.518675 8568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:59.518795 8568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:59.519814 8568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "e2a7a3f1af6045979ba95df5153048d2"
format_stamp: "Formatted at 2026-08-12 06:23:59 on dist-test-slave-gjrz"
server_key: "f86558eaee36cb41b6db42fdf7ef370f"
server_key_iv: "c5a38c486880160465fc67a09c1874e0"
server_key_version: "encryptionkey@0"
I20260812 06:23:59.520131 8568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "e2a7a3f1af6045979ba95df5153048d2"
format_stamp: "Formatted at 2026-08-12 06:23:59 on dist-test-slave-gjrz"
server_key: "f86558eaee36cb41b6db42fdf7ef370f"
server_key_iv: "c5a38c486880160465fc67a09c1874e0"
server_key_version: "encryptionkey@0"
I20260812 06:23:59.521322 8568 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:23:59.521993 8600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:59.522148 8568 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:23:59.522267 8568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "e2a7a3f1af6045979ba95df5153048d2"
format_stamp: "Formatted at 2026-08-12 06:23:59 on dist-test-slave-gjrz"
server_key: "f86558eaee36cb41b6db42fdf7ef370f"
server_key_iv: "c5a38c486880160465fc67a09c1874e0"
server_key_version: "encryptionkey@0"
I20260812 06:23:59.522357 8568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:59.542157 8568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:59.542394 8568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:59.542538 8568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:59.546088 8568 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:34605
I20260812 06:23:59.546121 8712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:34605 every 8 connection(s)
I20260812 06:23:59.546393 8568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:59.546990 8714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:59.549407 8714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2: Bootstrap starting.
I20260812 06:23:59.549944 8714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:59.550208 8714 log.cc:824] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:59.550824 8714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2: No bootstrap required, opened a new log
I20260812 06:23:59.552114 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 8568
I20260812 06:23:59.552219 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:59.552407 30781 external_mini_cluster.cc:1428] Setting key d24f72c0c41ce16b9cf168d7ddc51d25
I20260812 06:23:59.552630 8714 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2a7a3f1af6045979ba95df5153048d2" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34605 } }
I20260812 06:23:59.552750 8714 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:59.552783 8714 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a7a3f1af6045979ba95df5153048d2, State: Initialized, Role: FOLLOWER
I20260812 06:23:59.552893 8714 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2a7a3f1af6045979ba95df5153048d2" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34605 } }
I20260812 06:23:59.552974 8714 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:59.553004 8714 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:59.553046 8714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:59.553679 8714 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2a7a3f1af6045979ba95df5153048d2" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34605 } }
I20260812 06:23:59.553784 8714 leader_election.cc:302] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2a7a3f1af6045979ba95df5153048d2; no voters:
I20260812 06:23:59.553925 8714 leader_election.cc:288] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:59.554121 8723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:59.554155 8714 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:59.554248 8723 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [term 1 LEADER]: Becoming Leader. State: Replica: e2a7a3f1af6045979ba95df5153048d2, State: Running, Role: LEADER
I20260812 06:23:59.554340 8723 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2a7a3f1af6045979ba95df5153048d2" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34605 } }
I20260812 06:23:59.554666 8725 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2a7a3f1af6045979ba95df5153048d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2a7a3f1af6045979ba95df5153048d2" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34605 } } }
I20260812 06:23:59.554741 8725 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:59.554875 8725 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2a7a3f1af6045979ba95df5153048d2. Latest consensus state: current_term: 1 leader_uuid: "e2a7a3f1af6045979ba95df5153048d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2a7a3f1af6045979ba95df5153048d2" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34605 } } }
I20260812 06:23:59.554926 8738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:59.554942 8725 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:59.555879 8738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:59.557870 8738 catalog_manager.cc:1347] Generated new cluster ID: dd078d0d98fc4751a0c30bb22e82a836
I20260812 06:23:59.557946 8738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:23:59.558054 8722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.552865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43228 (local address 127.30.15.126:34605)
0812 06:23:59.553105 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:59.553113 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:59.553144 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:23:59.553259 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:59.553266 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:59.553339 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:59.553486 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:59.553662 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.554961 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.556087 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.556656 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.556770 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:59.557347 (+ 577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:59.557350 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:59.557350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:59.557528 (+ 178us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:59.557559 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:59.557569 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:59.557623 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:59.557717 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 06:23:59.557792 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":91,"threads_started":1}
I20260812 06:23:59.558844 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:23:59.582402 8738 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:59.583065 8738 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:59.589185 8738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2a7a3f1af6045979ba95df5153048d2: Generated new TSK 0
I20260812 06:23:59.589344 8738 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 06:23:59.617035 8768 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 06:23:59.617097 8768 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 06:23:59.617323 8722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.595998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43234 (local address 127.30.15.126:34605)
0812 06:23:59.596042 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:59.596044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:59.596159 (+ 115us) server_negotiation.cc:407] Connection header received
0812 06:23:59.596230 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:59.596231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:59.596242 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:59.596299 (+ 57us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:23:59.596422 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.596908 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.597631 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.597841 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.597894 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:59.598066 (+ 172us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:23:59.617143 (+ 19077us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 06:23:59.617273 (+ 130us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43234: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 06:23:59.617367 8722 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43234: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 06:23:59.617443 8766 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:23:59.595948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:34605 (local address 127.0.0.1:43234)
0812 06:23:59.596095 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:59.596105 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:59.596166 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:59.596303 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:59.596304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:59.596306 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:23:59.596363 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:59.596364 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.596978 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.596980 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:59.597556 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:59.597558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.597916 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.597917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:59.597977 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:59.597983 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:23:59.617243 (+ 19260us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 06:23:59.617347 (+ 104us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.15.126:34605: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44359/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":92,"threads_started":1}
I20260812 06:23:59.617743 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 8568
2026-08-12T06:23:59Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (247 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 06:23:59.666606 30781 mini_oidc.cc:152] Starting JWKS server
I20260812 06:23:59.667232 30781 webserver.cc:460] Webserver started at https://127.0.0.1:40499/ using document root <none> and password file <none>
I20260812 06:23:59.667294 30781 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 06:23:59.667435 30781 webserver.cc:460] Webserver started at http://127.0.0.1:36031/ using document root <none> and password file <none>
2026-08-12T06:23:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:59Z Disabled control of system clock
I20260812 06:23:59.675248 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:34711
--webserver_interface=127.30.15.126
--webserver_port=0
--builtin_ntp_servers=127.30.15.84:42289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:34711
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40499/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 06:23:59.754521 8779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:59.754698 8779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:59.754717 8779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:59.755805 8779 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:59.755839 8779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:59.755851 8779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:59.755861 8779 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:59.755875 8779 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:23:59.755887 8779 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:23:59.755898 8779 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40499/jwks.json
I20260812 06:23:59.757167 8779 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:42289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:34711
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:34711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40499/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:59.757350 8779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:59.757570 8779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:59.761940 8793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:59.761991 8779 server_base.cc:1034] running on GCE node
W20260812 06:23:59.761977 8791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:59.761977 8786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:59.762359 8779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:59.762622 8779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:59.763754 8779 hybrid_clock.cc:648] HybridClock initialized: now 1786515839763741 us; error 30 us; skew 500 ppm
I20260812 06:23:59.764838 8779 webserver.cc:460] Webserver started at http://127.30.15.126:37671/ using document root <none> and password file <none>
I20260812 06:23:59.765038 8779 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:59.765080 8779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:59.765194 8779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:59.766140 8779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "1f5f83df8dd548269d956a3bb4d2aa09"
format_stamp: "Formatted at 2026-08-12 06:23:59 on dist-test-slave-gjrz"
server_key: "f12d0b01ecde0b863b02bce2ec0b1734"
server_key_iv: "af73a9eae814eae55c9fdf443e7f25b4"
server_key_version: "encryptionkey@0"
I20260812 06:23:59.766439 8779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "1f5f83df8dd548269d956a3bb4d2aa09"
format_stamp: "Formatted at 2026-08-12 06:23:59 on dist-test-slave-gjrz"
server_key: "f12d0b01ecde0b863b02bce2ec0b1734"
server_key_iv: "af73a9eae814eae55c9fdf443e7f25b4"
server_key_version: "encryptionkey@0"
I20260812 06:23:59.767659 8779 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:23:59.768306 8811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:59.768447 8779 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:59.768523 8779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "1f5f83df8dd548269d956a3bb4d2aa09"
format_stamp: "Formatted at 2026-08-12 06:23:59 on dist-test-slave-gjrz"
server_key: "f12d0b01ecde0b863b02bce2ec0b1734"
server_key_iv: "af73a9eae814eae55c9fdf443e7f25b4"
server_key_version: "encryptionkey@0"
I20260812 06:23:59.768586 8779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:59.780779 8779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:59.781008 8779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:59.781118 8779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:59.784795 8779 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:34711
I20260812 06:23:59.784837 8927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:34711 every 8 connection(s)
I20260812 06:23:59.785109 8779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:59.785784 8928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:59.788196 8928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09: Bootstrap starting.
I20260812 06:23:59.788714 8928 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:59.789005 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 8779
I20260812 06:23:59.789014 8928 log.cc:824] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:59.789108 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:59.789309 30781 external_mini_cluster.cc:1428] Setting key db07212bc6f421ac112896c8c6213d1e
I20260812 06:23:59.789712 8928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09: No bootstrap required, opened a new log
I20260812 06:23:59.791970 8928 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5f83df8dd548269d956a3bb4d2aa09" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34711 } }
I20260812 06:23:59.792100 8928 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:59.792133 8928 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f5f83df8dd548269d956a3bb4d2aa09, State: Initialized, Role: FOLLOWER
I20260812 06:23:59.792251 8928 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5f83df8dd548269d956a3bb4d2aa09" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34711 } }
I20260812 06:23:59.792325 8928 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:59.792354 8928 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:59.792398 8928 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:59.792881 8928 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5f83df8dd548269d956a3bb4d2aa09" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34711 } }
I20260812 06:23:59.792982 8928 leader_election.cc:302] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f5f83df8dd548269d956a3bb4d2aa09; no voters:
I20260812 06:23:59.793138 8928 leader_election.cc:288] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:59.793179 8938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:59.793324 8938 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [term 1 LEADER]: Becoming Leader. State: Replica: 1f5f83df8dd548269d956a3bb4d2aa09, State: Running, Role: LEADER
I20260812 06:23:59.793355 8928 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:59.793412 8938 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5f83df8dd548269d956a3bb4d2aa09" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34711 } }
I20260812 06:23:59.793988 8939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f5f83df8dd548269d956a3bb4d2aa09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5f83df8dd548269d956a3bb4d2aa09" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34711 } } }
I20260812 06:23:59.794068 8939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:59.794296 8952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:59.794405 8942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f5f83df8dd548269d956a3bb4d2aa09. Latest consensus state: current_term: 1 leader_uuid: "1f5f83df8dd548269d956a3bb4d2aa09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5f83df8dd548269d956a3bb4d2aa09" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34711 } } }
I20260812 06:23:59.794482 8942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:59.794845 8952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:59.795493 8933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.789706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38748 (local address 127.30.15.126:34711)
0812 06:23:59.789890 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:59.789896 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:59.789927 (+ 31us) server_negotiation.cc:407] Connection header received
0812 06:23:59.790791 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:59.790797 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:59.790856 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:59.790967 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:59.791232 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.792134 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.792941 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.793536 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.793713 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:59.794551 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:59.794554 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:59.794555 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:59.794736 (+ 181us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:59.794775 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:59.794789 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:59.794885 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:59.794989 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 06:23:59.795066 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":59,"threads_started":1}
I20260812 06:23:59.796484 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:23:59.796763 8952 catalog_manager.cc:1347] Generated new cluster ID: 50501d0bf755455dba5fd6d037248d57
I20260812 06:23:59.796811 8952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:23:59.806907 8952 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:23:59.807441 8952 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:23:59.812747 8952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f5f83df8dd548269d956a3bb4d2aa09: Generated new TSK 0
I20260812 06:23:59.812883 8952 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:23:59.821283 8933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.817813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38750 (local address 127.30.15.126:34711)
0812 06:23:59.817850 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:59.817852 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:59.817922 (+ 70us) server_negotiation.cc:407] Connection header received
0812 06:23:59.817972 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:59.817973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:59.817984 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:59.818056 (+ 72us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:23:59.818138 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.818885 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.819653 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.819966 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.820048 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:59.820216 (+ 168us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:23:59.821095 (+ 879us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40499/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 06:23:59.821217 (+ 122us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38750: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40499/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 06:23:59.821334 8933 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38750: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40499/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 06:23:59.823307 8981 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:23:59.817721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:34711 (local address 127.0.0.1:38750)
0812 06:23:59.817854 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 06:23:59.817864 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:23:59.817925 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:23:59.818063 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:23:59.818064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:23:59.818065 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:23:59.818103 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:59.818104 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.818964 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.818964 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:59.819588 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:23:59.819590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.820070 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.820071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:23:59.820124 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:59.820130 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:23:59.821196 (+ 1066us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40499/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 06:23:59.823191 (+ 1995us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.15.126:34711: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40499/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":1801,"thread_start_us":82,"threads_started":1}
I20260812 06:23:59.823698 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 8779
E20260812 06:23:59.834301 8982 webserver.cc:533] Webserver: sslize failed:
E20260812 06:23:59.834354 8982 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-12T06:23:59Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (195 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T06:23:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:23:59Z Disabled control of system clock
I20260812 06:23:59.869764 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:42735
--webserver_interface=127.30.15.126
--webserver_port=0
--builtin_ntp_servers=127.30.15.84:33293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:42735
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/testchainca.cert with env {}
W20260812 06:23:59.947618 8997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:23:59.947795 8997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:23:59.947825 8997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:23:59.948921 8997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:23:59.948968 8997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:23:59.948985 8997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:23:59.949002 8997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:23:59.949016 8997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 06:23:59.949038 8997 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 06:23:59.949054 8997 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 06:23:59.950515 8997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:33293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:42735
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:42735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:23:59.950736 8997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:23:59.950922 8997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:23:59.955317 9010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:59.955353 9016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:23:59.955329 9009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:23:59.955551 8997 server_base.cc:1034] running on GCE node
I20260812 06:23:59.955758 8997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:23:59.956012 8997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:23:59.957149 8997 hybrid_clock.cc:648] HybridClock initialized: now 1786515839957136 us; error 24 us; skew 500 ppm
I20260812 06:23:59.958207 8997 webserver.cc:460] Webserver started at http://127.30.15.126:37991/ using document root <none> and password file <none>
I20260812 06:23:59.958424 8997 fs_manager.cc:359] Metadata directory not provided
I20260812 06:23:59.958478 8997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:23:59.958598 8997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:23:59.959590 8997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "a5e12c57606f4999840cccd9fe55ec12"
format_stamp: "Formatted at 2026-08-12 06:23:59 on dist-test-slave-gjrz"
server_key: "4be965ca257cedbad4f3f7c440d1ef6a"
server_key_iv: "bd5eb48d11b0f9fa409d776c4a5ba360"
server_key_version: "encryptionkey@0"
I20260812 06:23:59.959895 8997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "a5e12c57606f4999840cccd9fe55ec12"
format_stamp: "Formatted at 2026-08-12 06:23:59 on dist-test-slave-gjrz"
server_key: "4be965ca257cedbad4f3f7c440d1ef6a"
server_key_iv: "bd5eb48d11b0f9fa409d776c4a5ba360"
server_key_version: "encryptionkey@0"
I20260812 06:23:59.961045 8997 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:23:59.961719 9028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:23:59.961884 8997 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:23:59.961973 8997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "a5e12c57606f4999840cccd9fe55ec12"
format_stamp: "Formatted at 2026-08-12 06:23:59 on dist-test-slave-gjrz"
server_key: "4be965ca257cedbad4f3f7c440d1ef6a"
server_key_iv: "bd5eb48d11b0f9fa409d776c4a5ba360"
server_key_version: "encryptionkey@0"
I20260812 06:23:59.962038 8997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:23:59.975855 8997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:23:59.976090 8997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:23:59.976205 8997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:23:59.979882 8997 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:42735
I20260812 06:23:59.979911 9139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:42735 every 8 connection(s)
I20260812 06:23:59.980185 8997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:23:59.981072 9140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:23:59.983202 9140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12: Bootstrap starting.
I20260812 06:23:59.983517 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 8997
I20260812 06:23:59.983593 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:23:59.983749 30781 external_mini_cluster.cc:1428] Setting key 61c34fe00f56c790fed9ddee6afbc540
I20260812 06:23:59.983789 9140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12: Neither blocks nor log segments found. Creating new log.
I20260812 06:23:59.984086 9140 log.cc:824] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12: Log is configured to *not* fsync() on all Append() calls
I20260812 06:23:59.984794 9140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12: No bootstrap required, opened a new log
I20260812 06:23:59.986805 9140 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5e12c57606f4999840cccd9fe55ec12" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 42735 } }
I20260812 06:23:59.986975 9140 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:23:59.987008 9140 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5e12c57606f4999840cccd9fe55ec12, State: Initialized, Role: FOLLOWER
I20260812 06:23:59.987130 9140 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5e12c57606f4999840cccd9fe55ec12" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 42735 } }
I20260812 06:23:59.987226 9140 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:23:59.987251 9140 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:23:59.987322 9140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:23:59.987859 9140 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5e12c57606f4999840cccd9fe55ec12" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 42735 } }
I20260812 06:23:59.987982 9140 leader_election.cc:302] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5e12c57606f4999840cccd9fe55ec12; no voters:
I20260812 06:23:59.988134 9140 leader_election.cc:288] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:23:59.988262 9152 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:23:59.988400 9140 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:23:59.989169 9144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:23:59.984171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59426 (local address 127.30.15.126:42735)
0812 06:23:59.984370 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 06:23:59.984378 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:23:59.984408 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:23:59.984847 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:23:59.984854 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:23:59.984920 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:23:59.985040 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:23:59.985262 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.986087 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.987185 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:23:59.987680 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:23:59.987767 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:23:59.988437 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:23:59.988441 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:23:59.988441 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:23:59.988661 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:23:59.988700 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:23:59.988714 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:23:59.988752 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0812 06:23:59.988938 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 06:23:59.989023 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":79,"threads_started":1}
I20260812 06:23:59.988408 9152 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [term 1 LEADER]: Becoming Leader. State: Replica: a5e12c57606f4999840cccd9fe55ec12, State: Running, Role: LEADER
I20260812 06:23:59.989784 9152 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5e12c57606f4999840cccd9fe55ec12" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 42735 } }
I20260812 06:23:59.990051 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:23:59.990352 9156 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5e12c57606f4999840cccd9fe55ec12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5e12c57606f4999840cccd9fe55ec12" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 42735 } } }
I20260812 06:23:59.990453 9156 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [sys.catalog]: This master's current role is: LEADER
I20260812 06:23:59.990350 9154 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5e12c57606f4999840cccd9fe55ec12. Latest consensus state: current_term: 1 leader_uuid: "a5e12c57606f4999840cccd9fe55ec12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5e12c57606f4999840cccd9fe55ec12" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 42735 } } }
I20260812 06:23:59.990533 9154 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12 [sys.catalog]: This master's current role is: LEADER
W20260812 06:23:59.991211 9191 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:23:59.991256 9191 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:23:59.991349 9190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:23:59.991518 9190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:23:59.992866 9190 catalog_manager.cc:1347] Generated new cluster ID: 0a261c35827d4855a9c41bd72cec4e77
I20260812 06:23:59.992910 9190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:24:00.008809 9190 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:24:00.009284 9190 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:24:00.012729 9190 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5e12c57606f4999840cccd9fe55ec12: Generated new TSK 0
I20260812 06:24:00.012884 9190 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:24:00.029264 9144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:00.019156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59428 (local address 127.30.15.126:42735)
0812 06:24:00.019195 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:00.019197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:00.019275 (+ 78us) server_negotiation.cc:407] Connection header received
0812 06:24:00.019364 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:00.019365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:00.019376 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:00.019450 (+ 74us) server_negotiation.cc:226] Negotiated authn=JWT
0812 06:24:00.019543 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:00.020314 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:00.021006 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:00.021312 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:00.021377 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:00.021495 (+ 118us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 06:24:00.029062 (+ 7567us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 06:24:00.029204 (+ 142us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59428: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 06:24:00.029318 9144 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59428: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 06:24:00.029335 9207 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:00.019087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:42735 (local address 127.0.0.1:59428)
0812 06:24:00.019203 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:00.019212 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:00.019299 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:00.019447 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:00.019448 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:00.019449 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0812 06:24:00.019493 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:00.019494 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:00.020376 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:00.020377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:00.020934 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:00.020936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:00.021377 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:00.021377 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:00.021412 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:00.021416 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 06:24:00.029167 (+ 7751us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 06:24:00.029254 (+ 87us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.15.126:42735: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":65,"threads_started":1}
I20260812 06:24:00.029600 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 8997
2026-08-12T06:24:00Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (195 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (86 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (85 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:24:00 dist-test-slave-gjrz krb5kdc[9235](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:24:00 dist-test-slave-gjrz krb5kdc[9235](info): set up 2 sockets
Aug 12 06:24:00 dist-test-slave-gjrz krb5kdc[9235](info): commencing operation
krb5kdc: starting...
W20260812 06:24:01.395850 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:24:01 dist-test-slave-gjrz krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:24:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:24:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:24:01.508322 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:37165
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:37271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:37165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:01.586449 9261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:01.586633 9261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:01.586663 9261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:01.587983 9261 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:24:01.588038 9261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:01.588058 9261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:01.588075 9261 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:24:01.588105 9261 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:24:01.589517 9261 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:37271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:37165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:37165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:01.589721 9261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:01.589919 9261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:01.594282 9273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:01.594375 9271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:01.594348 9261 server_base.cc:1034] running on GCE node
W20260812 06:24:01.594286 9278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:01.594640 9261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:01.594902 9261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:01.596032 9261 hybrid_clock.cc:648] HybridClock initialized: now 1786515841596010 us; error 33 us; skew 500 ppm
Aug 12 06:24:01 dist-test-slave-gjrz krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515841, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:01.598239 9261 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:24:01.598645 9261 webserver.cc:460] Webserver started at http://127.30.15.126:39241/ using document root <none> and password file <none>
I20260812 06:24:01.598829 9261 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:01.598874 9261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:01.598994 9261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:01.600003 9261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "1ebd8088e2e44dbd8acfca848fa784a3"
format_stamp: "Formatted at 2026-08-12 06:24:01 on dist-test-slave-gjrz"
server_key: "1464122b4d20044dd4695eca0ecf6ac0"
server_key_iv: "89e05b8229fdea5e0fd78ed49e9e9e2c"
server_key_version: "encryptionkey@0"
I20260812 06:24:01.600358 9261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "1ebd8088e2e44dbd8acfca848fa784a3"
format_stamp: "Formatted at 2026-08-12 06:24:01 on dist-test-slave-gjrz"
server_key: "1464122b4d20044dd4695eca0ecf6ac0"
server_key_iv: "89e05b8229fdea5e0fd78ed49e9e9e2c"
server_key_version: "encryptionkey@0"
I20260812 06:24:01.601634 9261 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:24:01.602309 9296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:01.602471 9261 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:01.602557 9261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "1ebd8088e2e44dbd8acfca848fa784a3"
format_stamp: "Formatted at 2026-08-12 06:24:01 on dist-test-slave-gjrz"
server_key: "1464122b4d20044dd4695eca0ecf6ac0"
server_key_iv: "89e05b8229fdea5e0fd78ed49e9e9e2c"
server_key_version: "encryptionkey@0"
I20260812 06:24:01.602622 9261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:01.629944 9261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:01.631652 9261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:01.631780 9261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:01.635555 9261 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:37165
I20260812 06:24:01.635593 9422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:37165 every 8 connection(s)
I20260812 06:24:01.635902 9261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:24:01.636695 9424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:01.638950 9424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3: Bootstrap starting.
I20260812 06:24:01.639565 9424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:01.639830 9424 log.cc:824] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:01.640534 9424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3: No bootstrap required, opened a new log
I20260812 06:24:01.642104 9424 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebd8088e2e44dbd8acfca848fa784a3" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37165 } }
I20260812 06:24:01.642237 9424 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:01.642270 9424 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ebd8088e2e44dbd8acfca848fa784a3, State: Initialized, Role: FOLLOWER
I20260812 06:24:01.642416 9424 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebd8088e2e44dbd8acfca848fa784a3" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37165 } }
I20260812 06:24:01.642513 9424 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:24:01.642511 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 9261
I20260812 06:24:01.642549 9424 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:24:01.642601 9424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:01.642614 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:24:01.642791 30781 external_mini_cluster.cc:1428] Setting key 3e4e3801670a2e67fe4374e024e540ea
I20260812 06:24:01.643224 9424 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebd8088e2e44dbd8acfca848fa784a3" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37165 } }
I20260812 06:24:01.643373 9424 leader_election.cc:302] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ebd8088e2e44dbd8acfca848fa784a3; no voters:
I20260812 06:24:01.643537 9424 leader_election.cc:288] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:24:01.643718 9431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:01.643779 9424 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:24:01.643851 9431 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1ebd8088e2e44dbd8acfca848fa784a3, State: Running, Role: LEADER
I20260812 06:24:01.643942 9431 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebd8088e2e44dbd8acfca848fa784a3" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37165 } }
I20260812 06:24:01.644280 9431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ebd8088e2e44dbd8acfca848fa784a3. Latest consensus state: current_term: 1 leader_uuid: "1ebd8088e2e44dbd8acfca848fa784a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebd8088e2e44dbd8acfca848fa784a3" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37165 } } }
I20260812 06:24:01.644357 9431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:01.644507 9432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ebd8088e2e44dbd8acfca848fa784a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebd8088e2e44dbd8acfca848fa784a3" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37165 } } }
I20260812 06:24:01.644582 9432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3 [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:01.644693 9455 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:24:01.645164 9455 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:24:01.648006 9455 catalog_manager.cc:1347] Generated new cluster ID: 0946e99558db42e8820054e5d7f91154
I20260812 06:24:01.648054 9455 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:24:01 dist-test-slave-gjrz krb5kdc[9235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:24:01.654033 9430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:01.643258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38380 (local address 127.30.15.126:37165)
0812 06:24:01.643465 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:01.643474 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:01.643504 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:24:01.643623 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:01.643629 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:01.643684 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:01.644658 (+ 974us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:01.644765 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:01.646149 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:01.646880 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:01.647348 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:01.647451 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:01.650205 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:01.650209 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:01.650209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:01.650220 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:01.652511 (+ 2291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:01.652899 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:01.652901 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:01.652902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:01.652993 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:01.653179 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:01.653180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:01.653180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:01.653448 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:01.653576 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:01.653697 (+ 121us) server_negotiation.cc:299] Negotiation successful
0812 06:24:01.653820 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":87,"threads_started":1}
I20260812 06:24:01.659219 9455 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:24:01.659749 9455 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:24:01.671109 9455 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ebd8088e2e44dbd8acfca848fa784a3: Generated new TSK 0
I20260812 06:24:01.671252 9455 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:24:01.697888 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37165
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:37271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:01.778714 9479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:01.778887 9479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:01.778908 9479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:01.780054 9479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:01.780093 9479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:01.780120 9479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:24:01.781543 9479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:37271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:01.781750 9479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:01.781960 9479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:01.786494 9491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:01.786597 9479 server_base.cc:1034] running on GCE node
W20260812 06:24:01.786504 9497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:01.786772 9490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:01.786964 9479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:01.787185 9479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:01.788321 9479 hybrid_clock.cc:648] HybridClock initialized: now 1786515841788320 us; error 39 us; skew 500 ppm
Aug 12 06:24:01 dist-test-slave-gjrz krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515841, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:01.790668 9479 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:24:01.791078 9479 webserver.cc:460] Webserver started at http://127.30.15.65:38733/ using document root <none> and password file <none>
I20260812 06:24:01.791323 9479 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:01.791378 9479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:01.791503 9479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:01.792451 9479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "6518e499696f4b0ebf033810e02c70ff"
format_stamp: "Formatted at 2026-08-12 06:24:01 on dist-test-slave-gjrz"
server_key: "24c7002551afaadd5254afc4ef25f515"
server_key_iv: "3eee0f6abdec4b7a4e97ae3528498ca0"
server_key_version: "encryptionkey@0"
I20260812 06:24:01.792778 9479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "6518e499696f4b0ebf033810e02c70ff"
format_stamp: "Formatted at 2026-08-12 06:24:01 on dist-test-slave-gjrz"
server_key: "24c7002551afaadd5254afc4ef25f515"
server_key_iv: "3eee0f6abdec4b7a4e97ae3528498ca0"
server_key_version: "encryptionkey@0"
I20260812 06:24:01.793934 9479 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:24:01.794577 9510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:01.794718 9479 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:24:01.794797 9479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "6518e499696f4b0ebf033810e02c70ff"
format_stamp: "Formatted at 2026-08-12 06:24:01 on dist-test-slave-gjrz"
server_key: "24c7002551afaadd5254afc4ef25f515"
server_key_iv: "3eee0f6abdec4b7a4e97ae3528498ca0"
server_key_version: "encryptionkey@0"
I20260812 06:24:01.794863 9479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:01.830605 9479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:01.832253 9479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:01.832378 9479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:01.832581 9479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:01.832850 9479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:01.832883 9479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:01.832911 9479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:01.832928 9479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:01.838372 9479 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:39995
I20260812 06:24:01.838426 9733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:39995 every 8 connection(s)
I20260812 06:24:01.838698 9479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:24:01.842479 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 9479
I20260812 06:24:01.842566 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:24:01.842724 30781 external_mini_cluster.cc:1428] Setting key 0eed2a0f7b8580f7787e85eec50fdf3f
Aug 12 06:24:01 dist-test-slave-gjrz krb5kdc[9235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515841, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:24:01.847631 9430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:01.839330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:40867 (local address 127.30.15.126:37165)
0812 06:24:01.839374 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:01.839376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:01.839567 (+ 191us) server_negotiation.cc:407] Connection header received
0812 06:24:01.840440 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:01.840441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:01.840453 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:01.840504 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:01.841020 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:01.841512 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:01.842458 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:01.842689 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:01.842747 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:01.845146 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:01.845148 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:01.845148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:01.845157 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:01.846345 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:01.846703 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:01.846704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:01.846704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:01.846761 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:01.846966 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:01.846967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:01.846967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:01.847084 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:01.847140 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:01.847437 (+ 297us) server_negotiation.cc:299] Negotiation successful
0812 06:24:01.847537 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:24:01.847748 9739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:01.839293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37165 (local address 127.30.15.65:40867)
0812 06:24:01.839457 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:01.839497 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:01.840359 (+ 862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:01.840562 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:01.840565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:01.840785 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:01.840961 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:01.840965 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:01.841572 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:01.841572 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:01.842368 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:01.842370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:01.842765 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:01.842765 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:01.842908 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:01.843474 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:01.843483 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:01.845065 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:01.846417 (+ 1352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:01.846424 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:01.846426 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:01.846634 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:01.846813 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:01.846814 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:01.846814 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:01.846912 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:01.847138 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:01.847145 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:01.847295 (+ 150us) client_negotiation.cc:769] Sending connection context
0812 06:24:01.847394 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 06:24:01.847547 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":86,"threads_started":1}
I20260812 06:24:01.848188 9735 heartbeater.cc:347] Connected to a master server at 127.30.15.126:37165
I20260812 06:24:01.848268 9735 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:01.848428 9735 heartbeater.cc:511] Master 127.30.15.126:37165 requested a full tablet report, sending...
I20260812 06:24:01.848922 9344 ts_manager.cc:194] Registered new tserver with Master: 6518e499696f4b0ebf033810e02c70ff (127.30.15.65:39995)
I20260812 06:24:01.849524 9344 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:40867
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:24:01.867594 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37165
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:37271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:01.947178 9742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:01.947374 9742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:01.947397 9742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:01.948457 9742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:01.948493 9742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:01.948518 9742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:24:01.949894 9742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:37271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:01.950058 9742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:01.950223 9742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:01.954846 9749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:01.954849 9752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:01.954849 9755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:01.955134 9742 server_base.cc:1034] running on GCE node
I20260812 06:24:01.955349 9742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:01.955569 9742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:01.956709 9742 hybrid_clock.cc:648] HybridClock initialized: now 1786515841956693 us; error 34 us; skew 500 ppm
Aug 12 06:24:01 dist-test-slave-gjrz krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515841, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:01.959012 9742 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:24:01.959450 9742 webserver.cc:460] Webserver started at http://127.30.15.66:45717/ using document root <none> and password file <none>
I20260812 06:24:01.959652 9742 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:01.959698 9742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:01.959818 9742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:01.960739 9742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "e283f99b9625445e9bb915c95285ffa5"
format_stamp: "Formatted at 2026-08-12 06:24:01 on dist-test-slave-gjrz"
server_key: "c033b3a5a693714c67d1ce324fef10c1"
server_key_iv: "9c1d8c710dafa1e7e9488cbcf936fd9e"
server_key_version: "encryptionkey@0"
I20260812 06:24:01.961050 9742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "e283f99b9625445e9bb915c95285ffa5"
format_stamp: "Formatted at 2026-08-12 06:24:01 on dist-test-slave-gjrz"
server_key: "c033b3a5a693714c67d1ce324fef10c1"
server_key_iv: "9c1d8c710dafa1e7e9488cbcf936fd9e"
server_key_version: "encryptionkey@0"
I20260812 06:24:01.962424 9742 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:24:01.963122 9769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:01.963313 9742 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:01.963400 9742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "e283f99b9625445e9bb915c95285ffa5"
format_stamp: "Formatted at 2026-08-12 06:24:01 on dist-test-slave-gjrz"
server_key: "c033b3a5a693714c67d1ce324fef10c1"
server_key_iv: "9c1d8c710dafa1e7e9488cbcf936fd9e"
server_key_version: "encryptionkey@0"
I20260812 06:24:01.963465 9742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:01.977573 9742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:01.979521 9742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:01.979643 9742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:01.979839 9742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:01.980111 9742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:01.980144 9742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:01.980170 9742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:01.980187 9742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:01.985725 9742 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:45199
I20260812 06:24:01.985790 9998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:45199 every 8 connection(s)
I20260812 06:24:01.986047 9742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:24:01 dist-test-slave-gjrz krb5kdc[9235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515841, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:24:01.991871 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 9742
I20260812 06:24:01.991974 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:24:01.992125 30781 external_mini_cluster.cc:1428] Setting key ea19998f8cb95b664dfbe41865c53aeb
I20260812 06:24:01.994688 9430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:01.986659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:38443 (local address 127.30.15.126:37165)
0812 06:24:01.986712 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:01.986714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:01.986884 (+ 170us) server_negotiation.cc:407] Connection header received
0812 06:24:01.987811 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:01.987813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:01.987826 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:01.987885 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:01.988473 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:01.988978 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:01.989932 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:01.990137 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:01.990194 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:01.992174 (+ 1980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:01.992175 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:01.992176 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:01.992183 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:01.993453 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:01.993805 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:01.993806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:01.993807 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:01.993864 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:01.994089 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:01.994090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:01.994091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:01.994205 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:01.994256 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:01.994511 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 06:24:01.994598 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:24:01.994859 10003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:01.986614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37165 (local address 127.30.15.66:38443)
0812 06:24:01.986778 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:01.986811 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:01.987711 (+ 900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:01.987959 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:01.987963 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:01.988196 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:01.988381 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:01.988385 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:01.989063 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:01.989065 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:01.989852 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:01.989854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:01.990207 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:01.990208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:01.990322 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:01.990702 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:01.990710 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:01.992081 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:01.993524 (+ 1443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:01.993532 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:01.993534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:01.993737 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:01.993915 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:01.993916 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:01.993916 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:01.994032 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:01.994265 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:01.994272 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:01.994396 (+ 124us) client_negotiation.cc:769] Sending connection context
0812 06:24:01.994481 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:24:01.994655 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
I20260812 06:24:01.995302 9999 heartbeater.cc:347] Connected to a master server at 127.30.15.126:37165
I20260812 06:24:01.995406 9999 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:01.995570 9999 heartbeater.cc:511] Master 127.30.15.126:37165 requested a full tablet report, sending...
I20260812 06:24:01.995940 9344 ts_manager.cc:194] Registered new tserver with Master: e283f99b9625445e9bb915c95285ffa5 (127.30.15.66:45199)
I20260812 06:24:01.996380 9344 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:38443
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:24:02.018107 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37165
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:37271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:02.097087 10010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:02.097271 10010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:02.097293 10010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:02.098488 10010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:02.098531 10010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:02.098562 10010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:24:02.100042 10010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:37271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:02.100217 10010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:02.100382 10010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:02.105053 10021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:02.105122 10010 server_base.cc:1034] running on GCE node
W20260812 06:24:02.105093 10018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:02.105101 10017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:02.105449 10010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:02.105698 10010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:02.106840 10010 hybrid_clock.cc:648] HybridClock initialized: now 1786515842106827 us; error 26 us; skew 500 ppm
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515842, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:02.109180 10010 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:24:02.109568 10010 webserver.cc:460] Webserver started at http://127.30.15.67:44501/ using document root <none> and password file <none>
I20260812 06:24:02.109761 10010 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:02.109807 10010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:02.109928 10010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:02.110898 10010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "251a67cccb974ccbb88c9e57a597b1de"
format_stamp: "Formatted at 2026-08-12 06:24:02 on dist-test-slave-gjrz"
server_key: "6443c9603b70ff89de272beb6521c68d"
server_key_iv: "b5c22970966a338480f4f7bba17a0928"
server_key_version: "encryptionkey@0"
I20260812 06:24:02.111217 10010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "251a67cccb974ccbb88c9e57a597b1de"
format_stamp: "Formatted at 2026-08-12 06:24:02 on dist-test-slave-gjrz"
server_key: "6443c9603b70ff89de272beb6521c68d"
server_key_iv: "b5c22970966a338480f4f7bba17a0928"
server_key_version: "encryptionkey@0"
I20260812 06:24:02.112413 10010 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:02.113087 10032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:02.113227 10010 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:02.113305 10010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "251a67cccb974ccbb88c9e57a597b1de"
format_stamp: "Formatted at 2026-08-12 06:24:02 on dist-test-slave-gjrz"
server_key: "6443c9603b70ff89de272beb6521c68d"
server_key_iv: "b5c22970966a338480f4f7bba17a0928"
server_key_version: "encryptionkey@0"
I20260812 06:24:02.113365 10010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:02.124271 10010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:02.126191 10010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:02.126319 10010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:02.126509 10010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:02.126794 10010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:02.126827 10010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:02.126852 10010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:02.126868 10010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:02.132575 10010 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:42627
I20260812 06:24:02.132637 10267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:42627 every 8 connection(s)
I20260812 06:24:02.132877 10010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[9235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515842, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:24:02.141011 9430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:02.133470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:58523 (local address 127.30.15.126:37165)
0812 06:24:02.133534 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:02.133536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:02.133707 (+ 171us) server_negotiation.cc:407] Connection header received
0812 06:24:02.134578 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:02.134579 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:02.134588 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:02.134634 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:02.135194 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:02.135701 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:02.136653 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:02.136824 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:02.136864 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:02.138716 (+ 1852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:02.138717 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:02.138718 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:02.138724 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:02.139944 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:02.140277 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:02.140278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:02.140278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:02.140321 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:02.140534 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:02.140534 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:02.140534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:02.140626 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:02.140668 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:02.140893 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 06:24:02.140949 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:24:02.141171 10275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:02.133446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37165 (local address 127.30.15.67:58523)
0812 06:24:02.133599 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:02.133638 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:02.134494 (+ 856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:02.134691 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:02.134694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:02.134956 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:02.135132 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:02.135136 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:02.135776 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:02.135777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:02.136589 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:02.136591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:02.136917 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:02.136918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:02.137019 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:02.137389 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:02.137396 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:02.138643 (+ 1247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:02.140011 (+ 1368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:02.140018 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:02.140020 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:02.140221 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:02.140368 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:02.140368 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:02.140369 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:02.140481 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:02.140676 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:02.140682 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:02.140792 (+ 110us) client_negotiation.cc:769] Sending connection context
0812 06:24:02.140881 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 06:24:02.140998 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":85,"threads_started":1}
I20260812 06:24:02.141580 10271 heartbeater.cc:347] Connected to a master server at 127.30.15.126:37165
I20260812 06:24:02.141659 10271 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:02.141789 10271 heartbeater.cc:511] Master 127.30.15.126:37165 requested a full tablet report, sending...
I20260812 06:24:02.142176 9344 ts_manager.cc:194] Registered new tserver with Master: 251a67cccb974ccbb88c9e57a597b1de (127.30.15.67:42627)
I20260812 06:24:02.142356 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 10010
I20260812 06:24:02.142444 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:24:02.142596 30781 external_mini_cluster.cc:1428] Setting key 4e69e34a115ad5a3f40d01c14f0beca7
I20260812 06:24:02.142652 9344 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:58523
I20260812 06:24:02.143497 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/test-admin.keytab.
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:02.159758 30781 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 06:24:02.161211 10290 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:02.160500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46082 (local address 127.30.15.65:39995)
0812 06:24:02.160651 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:02.160655 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:02.160663 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:02.160686 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:02.160687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:02.160700 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:02.160761 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:02.161133 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46082: BlockingRecv error: recv got EOF from 127.0.0.1:46082 (error 108)
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
W20260812 06:24:02.161260 30781 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/krb5cc' of type FILE
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:02.162190 30781 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:02.163043 30781 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[9235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.65@KRBTEST.COM
I20260812 06:24:02.170018 10290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:02.163537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46092 (local address 127.30.15.65:39995)
0812 06:24:02.163577 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:02.163579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:02.163609 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:24:02.163661 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:02.163662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:02.163671 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:02.163713 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:02.164045 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:02.164759 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:02.165411 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:02.165703 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:02.165750 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:02.167600 (+ 1850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:02.167609 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:02.167609 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:02.167616 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:02.169001 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:02.169305 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:02.169308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:02.169308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:02.169357 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:02.169522 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:02.169523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:02.169523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:02.169646 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:02.169770 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:02.169845 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 06:24:02.169924 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 06:24:02.171665 10290 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:02.171149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46102 (local address 127.30.15.65:39995)
0812 06:24:02.171198 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:02.171200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:02.171208 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:02.171296 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:02.171297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:02.171307 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:02.171354 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:02.171625 (+ 271us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46102: BlockingRecv error: recv got EOF from 127.0.0.1:46102 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260812 06:24:02.171782 30781 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/krb5cc' of type FILE
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:02.172585 30781 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:02.173283 30781 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[9235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.65@KRBTEST.COM
I20260812 06:24:02.179311 10290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:02.173699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46110 (local address 127.30.15.65:39995)
0812 06:24:02.173744 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:02.173746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:02.173756 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:24:02.173828 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:02.173829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:02.173836 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:02.173875 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:02.174215 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:02.174676 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:02.175309 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:02.175507 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:02.175559 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:02.177238 (+ 1679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:02.177240 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:02.177240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:02.177247 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:02.178371 (+ 1124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:02.178661 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:02.178662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:02.178662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:02.178709 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:02.178866 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:02.178867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:02.178867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:02.178951 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:02.179034 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:02.179128 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 06:24:02.179205 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260812 06:24:02.180574 10290 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:02.180089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46124 (local address 127.30.15.65:39995)
0812 06:24:02.180119 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:02.180120 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:02.180161 (+ 41us) server_negotiation.cc:407] Connection header received
0812 06:24:02.180201 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:02.180202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:02.180208 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:02.180250 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:02.180535 (+ 285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46124: BlockingRecv error: recv got EOF from 127.0.0.1:46124 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260812 06:24:02.180718 30781 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/krb5cc' of type FILE: Runtime error: Bad format in credentials cache (filename: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786515816548244-30781-0/krb5kdc/krb5cc)
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:02.181516 30781 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:02.182255 30781 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[9235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.65@KRBTEST.COM
I20260812 06:24:02.188589 10290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:02.182702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46130 (local address 127.30.15.65:39995)
0812 06:24:02.182754 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:02.182756 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:02.182764 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:02.182802 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:02.182803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:02.182810 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:02.182854 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:02.183170 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:02.183873 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:02.184651 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:02.184840 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:02.184889 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:02.186652 (+ 1763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:02.186654 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:02.186654 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:02.186660 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:02.187856 (+ 1196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:02.188126 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:02.188127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:02.188127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:02.188167 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:02.188282 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:02.188282 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:02.188282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:02.188352 (+ 70us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:02.188409 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:02.188487 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 06:24:02.188536 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:24:02.189074 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 9479
I20260812 06:24:02.204068 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 9742
I20260812 06:24:02.217305 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 10010
I20260812 06:24:02.225965 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 9261
2026-08-12T06:24:02Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2023 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[10314](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[10314](info): set up 2 sockets
Aug 12 06:24:02 dist-test-slave-gjrz krb5kdc[10314](info): commencing operation
krb5kdc: starting...
W20260812 06:24:03.416790 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:24:03 dist-test-slave-gjrz krb5kdc[10314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:24:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:24:03Z Disabled control of system clock
WARNING: no policy specified for oryx/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.126.keytab.
Entry for principal oryx/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.126.keytab.
I20260812 06:24:03.527981 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:37123
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.126.keytab
--principal=oryx/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:37123
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:03.606576 10341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:03.606755 10341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:03.606774 10341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:03.607900 10341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:24:03.607944 10341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:03.607973 10341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:03.607997 10341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:24:03.608019 10341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:24:03.609439 10341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:37123
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.126.keytab
--principal=oryx/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:37123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:03.609680 10341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:03.609875 10341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:03.614333 10354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:03.614328 10351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:03.614310 10352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:03.614346 10341 server_base.cc:1034] running on GCE node
I20260812 06:24:03.614725 10341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:03.614995 10341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:03.616143 10341 hybrid_clock.cc:648] HybridClock initialized: now 1786515843616124 us; error 36 us; skew 500 ppm
Aug 12 06:24:03 dist-test-slave-gjrz krb5kdc[10314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515843, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:03.621589 10341 init.cc:377] Logged in from keytab as oryx/127.30.15.126@KRBTEST.COM (short username oryx)
I20260812 06:24:03.622021 10341 webserver.cc:460] Webserver started at http://127.30.15.126:36137/ using document root <none> and password file <none>
I20260812 06:24:03.622210 10341 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:03.622253 10341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:03.622370 10341 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:03.623349 10341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd"
format_stamp: "Formatted at 2026-08-12 06:24:03 on dist-test-slave-gjrz"
server_key: "97f9d920ad50a37be84aad12eb6a781f"
server_key_iv: "5155c3c2c3ffa1c3678626b4037183f0"
server_key_version: "encryptionkey@0"
I20260812 06:24:03.623756 10341 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd"
format_stamp: "Formatted at 2026-08-12 06:24:03 on dist-test-slave-gjrz"
server_key: "97f9d920ad50a37be84aad12eb6a781f"
server_key_iv: "5155c3c2c3ffa1c3678626b4037183f0"
server_key_version: "encryptionkey@0"
I20260812 06:24:03.624991 10341 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:03.625679 10366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:03.625828 10341 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:03.625911 10341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd"
format_stamp: "Formatted at 2026-08-12 06:24:03 on dist-test-slave-gjrz"
server_key: "97f9d920ad50a37be84aad12eb6a781f"
server_key_iv: "5155c3c2c3ffa1c3678626b4037183f0"
server_key_version: "encryptionkey@0"
I20260812 06:24:03.625983 10341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:03.650161 10341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:03.651753 10341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:03.651880 10341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:03.655644 10341 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:37123
I20260812 06:24:03.655681 10462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:37123 every 8 connection(s)
I20260812 06:24:03.655983 10341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:24:03.656852 10467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:03.658977 10467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd: Bootstrap starting.
I20260812 06:24:03.659545 10467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:03.659801 10467 log.cc:824] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:03.660431 10467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd: No bootstrap required, opened a new log
I20260812 06:24:03.661963 10467 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } }
I20260812 06:24:03.662119 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 10341
I20260812 06:24:03.662146 10467 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:03.662182 10467 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b50c6b548aa4ff5b3a6e46f491d44bd, State: Initialized, Role: FOLLOWER
I20260812 06:24:03.662202 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:24:03.662318 10467 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } }
I20260812 06:24:03.662388 30781 external_mini_cluster.cc:1428] Setting key bdd3f30a877a8951c2608738c1405235
I20260812 06:24:03.662395 10467 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:24:03.662426 10467 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:24:03.662473 10467 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:03.663295 10467 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } }
I20260812 06:24:03.663398 10467 leader_election.cc:302] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b50c6b548aa4ff5b3a6e46f491d44bd; no voters:
I20260812 06:24:03.663538 10467 leader_election.cc:288] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:24:03.663592 10477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:03.663704 10477 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 1 LEADER]: Becoming Leader. State: Replica: 1b50c6b548aa4ff5b3a6e46f491d44bd, State: Running, Role: LEADER
I20260812 06:24:03.663779 10467 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:24:03.663780 10477 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } }
I20260812 06:24:03.664254 10478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b50c6b548aa4ff5b3a6e46f491d44bd. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } }
I20260812 06:24:03.664338 10478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:03.664470 10481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } }
I20260812 06:24:03.664542 10481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:03.664659 10493 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:24:03.665148 10493 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:24:03.666692 10493 catalog_manager.cc:1347] Generated new cluster ID: f6cc4d2708c047ca83dc22b2c1e38414
I20260812 06:24:03.666742 10493 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:24:03 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:03.673228 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:03.662812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54200 (local address 127.30.15.126:37123)
0812 06:24:03.663019 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:03.663028 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:03.663057 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:24:03.663144 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:03.663149 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:03.663194 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:03.663331 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:03.664098 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:03.665417 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:03.666444 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:03.666997 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:03.667099 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:03.669724 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:03.669728 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:03.669729 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:03.669741 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:03.671672 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:03.672043 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:03.672046 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:03.672046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:03.672168 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:03.672346 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:03.672347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:03.672347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:03.672651 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:03.672824 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:03.672892 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 06:24:03.673032 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":95,"threads_started":1}
I20260812 06:24:03.685109 10493 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:24:03.685575 10493 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:24:03.690340 10493 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd: Generated new TSK 0
I20260812 06:24:03.690485 10493 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab.
Entry for principal oryx/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab.
I20260812 06:24:03.718111 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37123
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab
--principal=oryx/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:03.798314 10516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:03.798494 10516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:03.798524 10516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:03.799675 10516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:03.799713 10516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:03.799743 10516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:24:03.801149 10516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab
--principal=oryx/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:03.801353 10516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:03.801556 10516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:03.806106 10531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:03.806105 10526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:03.806139 10528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:03.806452 10516 server_base.cc:1034] running on GCE node
I20260812 06:24:03.806627 10516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:03.806802 10516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:03.807929 10516 hybrid_clock.cc:648] HybridClock initialized: now 1786515843807917 us; error 28 us; skew 500 ppm
Aug 12 06:24:03 dist-test-slave-gjrz krb5kdc[10314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515843, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:03.810232 10516 init.cc:377] Logged in from keytab as oryx/127.30.15.65@KRBTEST.COM (short username oryx)
I20260812 06:24:03.810623 10516 webserver.cc:460] Webserver started at http://127.30.15.65:36489/ using document root <none> and password file <none>
I20260812 06:24:03.810784 10516 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:03.810820 10516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:03.810907 10516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:03.811913 10516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "ee1f7a3ad5834111bf4c2bf180750ece"
format_stamp: "Formatted at 2026-08-12 06:24:03 on dist-test-slave-gjrz"
server_key: "d3681da67e801ef6aaf2b22fac3bfb5e"
server_key_iv: "11ff4bfcdc8dd334f3db43dac1cf07ce"
server_key_version: "encryptionkey@0"
I20260812 06:24:03.812242 10516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "ee1f7a3ad5834111bf4c2bf180750ece"
format_stamp: "Formatted at 2026-08-12 06:24:03 on dist-test-slave-gjrz"
server_key: "d3681da67e801ef6aaf2b22fac3bfb5e"
server_key_iv: "11ff4bfcdc8dd334f3db43dac1cf07ce"
server_key_version: "encryptionkey@0"
I20260812 06:24:03.813400 10516 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:24:03.814009 10547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:03.814150 10516 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:03.814221 10516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "ee1f7a3ad5834111bf4c2bf180750ece"
format_stamp: "Formatted at 2026-08-12 06:24:03 on dist-test-slave-gjrz"
server_key: "d3681da67e801ef6aaf2b22fac3bfb5e"
server_key_iv: "11ff4bfcdc8dd334f3db43dac1cf07ce"
server_key_version: "encryptionkey@0"
I20260812 06:24:03.814286 10516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:03.826682 10516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:03.828678 10516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:03.828800 10516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:03.828989 10516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:03.829249 10516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:03.829280 10516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:03.829299 10516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:03.829322 10516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:03.834797 10516 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:39219
I20260812 06:24:03.834859 10781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:39219 every 8 connection(s)
I20260812 06:24:03.835103 10516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:24:03 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515843, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:03.842569 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 10516
I20260812 06:24:03.842661 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:24:03.842832 30781 external_mini_cluster.cc:1428] Setting key f942378c54aa34dc80d898058611d174
I20260812 06:24:03.843232 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:03.835742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:55605 (local address 127.30.15.126:37123)
0812 06:24:03.835794 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:03.835796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:03.835967 (+ 171us) server_negotiation.cc:407] Connection header received
0812 06:24:03.836441 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:03.836443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:03.836458 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:03.836504 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:03.837394 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:03.837905 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:03.838851 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:03.839055 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:03.839113 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:03.840922 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:03.840924 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:03.840925 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:03.840932 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:03.841980 (+ 1048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:03.842331 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:03.842332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:03.842333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:03.842386 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:03.842598 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:03.842598 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:03.842599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:03.842726 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:03.842781 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:03.843077 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 06:24:03.843168 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:24:03.843428 10789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:03.835719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.65:55605)
0812 06:24:03.835860 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:03.835894 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:03.836343 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:03.836581 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:03.836585 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:03.837119 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:03.837296 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:03.837301 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:03.837988 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:03.837989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:03.838764 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:03.838767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:03.839125 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:03.839126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:03.839241 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:03.839623 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:03.839631 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:03.840833 (+ 1202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:03.842051 (+ 1218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:03.842058 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:03.842060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:03.842264 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:03.842441 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:03.842442 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:03.842442 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:03.842538 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:03.842784 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:03.842791 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:03.842926 (+ 135us) client_negotiation.cc:769] Sending connection context
0812 06:24:03.843034 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 06:24:03.843200 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":70,"threads_started":1}
I20260812 06:24:03.844033 10785 heartbeater.cc:347] Connected to a master server at 127.30.15.126:37123
I20260812 06:24:03.844123 10785 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:03.844280 10785 heartbeater.cc:511] Master 127.30.15.126:37123 requested a full tablet report, sending...
I20260812 06:24:03.844750 10397 ts_manager.cc:194] Registered new tserver with Master: ee1f7a3ad5834111bf4c2bf180750ece (127.30.15.65:39219)
I20260812 06:24:03.845319 10397 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:55605
WARNING: no policy specified for oryx/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab.
Entry for principal oryx/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab.
I20260812 06:24:03.866142 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37123
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab
--principal=oryx/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:03.945996 10794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:03.946173 10794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:03.946198 10794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:03.947304 10794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:03.947338 10794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:03.947363 10794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:24:03.948690 10794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab
--principal=oryx/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:03.948866 10794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:03.949034 10794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:03.953632 10814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:03.953634 10806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:03.953641 10803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:03.953802 10794 server_base.cc:1034] running on GCE node
I20260812 06:24:03.953969 10794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:03.954159 10794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:03.955297 10794 hybrid_clock.cc:648] HybridClock initialized: now 1786515843955287 us; error 25 us; skew 500 ppm
Aug 12 06:24:03 dist-test-slave-gjrz krb5kdc[10314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515843, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:03.957589 10794 init.cc:377] Logged in from keytab as oryx/127.30.15.66@KRBTEST.COM (short username oryx)
I20260812 06:24:03.957957 10794 webserver.cc:460] Webserver started at http://127.30.15.66:36857/ using document root <none> and password file <none>
I20260812 06:24:03.958135 10794 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:03.958180 10794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:03.958294 10794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:03.959227 10794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "6f72d3405a524e20b496d9750b728db1"
format_stamp: "Formatted at 2026-08-12 06:24:03 on dist-test-slave-gjrz"
server_key: "a76cf7246f1bb5b5b7c795d76d44aee4"
server_key_iv: "e6f959bec5a736100a78b21ad7319612"
server_key_version: "encryptionkey@0"
I20260812 06:24:03.959589 10794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "6f72d3405a524e20b496d9750b728db1"
format_stamp: "Formatted at 2026-08-12 06:24:03 on dist-test-slave-gjrz"
server_key: "a76cf7246f1bb5b5b7c795d76d44aee4"
server_key_iv: "e6f959bec5a736100a78b21ad7319612"
server_key_version: "encryptionkey@0"
I20260812 06:24:03.960788 10794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:03.961407 10829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:03.961540 10794 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:03.961619 10794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "6f72d3405a524e20b496d9750b728db1"
format_stamp: "Formatted at 2026-08-12 06:24:03 on dist-test-slave-gjrz"
server_key: "a76cf7246f1bb5b5b7c795d76d44aee4"
server_key_iv: "e6f959bec5a736100a78b21ad7319612"
server_key_version: "encryptionkey@0"
I20260812 06:24:03.961681 10794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:03.974887 10794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:03.976557 10794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:03.976675 10794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:03.976861 10794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:03.977129 10794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:03.977160 10794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:03.977187 10794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:03.977213 10794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:03.982712 10794 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:34441
I20260812 06:24:03.982750 11056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:34441 every 8 connection(s)
I20260812 06:24:03.983017 10794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:24:03 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515843, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:03.990201 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 10794
I20260812 06:24:03.990314 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:24:03.990504 30781 external_mini_cluster.cc:1428] Setting key 8d46dd0e45319f9f9dedbffd476e84ce
I20260812 06:24:03.991369 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:03.983670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:47423 (local address 127.30.15.126:37123)
0812 06:24:03.983750 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:03.983752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:03.983905 (+ 153us) server_negotiation.cc:407] Connection header received
0812 06:24:03.984340 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:03.984341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:03.984352 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:03.984401 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:03.985207 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:03.985704 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:03.986633 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:03.986832 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:03.986886 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:03.988739 (+ 1853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:03.988740 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:03.988741 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:03.988747 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:03.989966 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:03.990385 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:03.990387 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:03.990387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:03.990445 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:03.990723 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:03.990723 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:03.990724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:03.990855 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:03.990930 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:03.991173 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 06:24:03.991254 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 06:24:03.991540 11060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:03.983643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.66:47423)
0812 06:24:03.983800 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:03.983832 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:03.984256 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:03.984458 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:03.984461 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:03.984972 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:03.985143 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:03.985148 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:03.985772 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:03.985773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:03.986547 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:03.986549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:03.986893 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:03.986894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:03.986986 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:03.987389 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:03.987397 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:03.988663 (+ 1266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:03.990034 (+ 1371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:03.990041 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:03.990043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:03.990319 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:03.990508 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:03.990508 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:03.990509 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:03.990641 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:03.990925 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:03.990930 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:03.991042 (+ 112us) client_negotiation.cc:769] Sending connection context
0812 06:24:03.991142 (+ 100us) client_negotiation.cc:240] Negotiation successful
0812 06:24:03.991319 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260812 06:24:03.992043 11057 heartbeater.cc:347] Connected to a master server at 127.30.15.126:37123
I20260812 06:24:03.992132 11057 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:03.992290 11057 heartbeater.cc:511] Master 127.30.15.126:37123 requested a full tablet report, sending...
I20260812 06:24:03.992625 10397 ts_manager.cc:194] Registered new tserver with Master: 6f72d3405a524e20b496d9750b728db1 (127.30.15.66:34441)
I20260812 06:24:03.993072 10397 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:47423
WARNING: no policy specified for oryx/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab.
Entry for principal oryx/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab.
I20260812 06:24:04.013936 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37123
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab
--principal=oryx/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:04.093350 11063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:04.093530 11063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:04.093552 11063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:04.094825 11063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:04.094873 11063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:04.094902 11063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:24:04.096424 11063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab
--principal=oryx/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37123
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:04.096621 11063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:04.096820 11063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:04.101500 11075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:04.101634 11071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:04.101629 11070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:04.101773 11063 server_base.cc:1034] running on GCE node
I20260812 06:24:04.101969 11063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:04.102213 11063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:04.103327 11063 hybrid_clock.cc:648] HybridClock initialized: now 1786515844103304 us; error 34 us; skew 500 ppm
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:04.105749 11063 init.cc:377] Logged in from keytab as oryx/127.30.15.67@KRBTEST.COM (short username oryx)
I20260812 06:24:04.106184 11063 webserver.cc:460] Webserver started at http://127.30.15.67:32967/ using document root <none> and password file <none>
I20260812 06:24:04.106370 11063 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:04.106412 11063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:04.106536 11063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:04.107681 11063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "77eb826004a14efda7db38220b63e405"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "4f85e8cf8009d04b7358ffb86c52727a"
server_key_iv: "011b2d1137e09d4e61695dc7ceb92429"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.108011 11063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "77eb826004a14efda7db38220b63e405"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "4f85e8cf8009d04b7358ffb86c52727a"
server_key_iv: "011b2d1137e09d4e61695dc7ceb92429"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.109211 11063 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:24:04.109902 11092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.110100 11063 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:04.110180 11063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "77eb826004a14efda7db38220b63e405"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "4f85e8cf8009d04b7358ffb86c52727a"
server_key_iv: "011b2d1137e09d4e61695dc7ceb92429"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.110234 11063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:04.123894 11063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:04.125597 11063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:04.125731 11063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:04.125909 11063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:04.126235 11063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:04.126271 11063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.126291 11063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:04.126314 11063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.132067 11063 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:41593
I20260812 06:24:04.132133 11292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:41593 every 8 connection(s)
I20260812 06:24:04.132372 11063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:04.138401 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 11063
I20260812 06:24:04.138489 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:24:04.138826 30781 external_mini_cluster.cc:1428] Setting key 65afc2e5aa23fa615972d59246785850
I20260812 06:24:04.140893 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.133001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:56865 (local address 127.30.15.126:37123)
0812 06:24:04.133066 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.133069 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.133229 (+ 160us) server_negotiation.cc:407] Connection header received
0812 06:24:04.133731 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.133732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.133745 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.133796 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.134689 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.135190 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.136164 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.136365 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.136420 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.138311 (+ 1891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.138312 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.138313 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.138320 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.139659 (+ 1339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.140012 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.140013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.140014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.140071 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.140281 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.140282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.140282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.140399 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.140453 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.140716 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.140804 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:24:04.141024 11297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.132956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.67:56865)
0812 06:24:04.133122 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.133157 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.133636 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.133860 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.133864 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.134385 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.134586 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.134591 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.135294 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.135296 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.136078 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.136080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.136435 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.136436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.136557 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.136956 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.136963 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.138209 (+ 1246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.139728 (+ 1519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.139735 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.139737 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.139940 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.140124 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.140125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.140125 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.140225 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.140453 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.140460 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.140597 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.140682 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.140826 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":86,"threads_started":1}
I20260812 06:24:04.141439 11293 heartbeater.cc:347] Connected to a master server at 127.30.15.126:37123
I20260812 06:24:04.141522 11293 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:04.141659 11293 heartbeater.cc:511] Master 127.30.15.126:37123 requested a full tablet report, sending...
I20260812 06:24:04.141976 10397 ts_manager.cc:194] Registered new tserver with Master: 77eb826004a14efda7db38220b63e405 (127.30.15.67:41593)
I20260812 06:24:04.142307 10397 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:56865
I20260812 06:24:04.150347 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.30.15.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.125.keytab.
Entry for principal oryx/127.30.15.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.125.keytab.
I20260812 06:24:04.175024 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.125:36849
--webserver_interface=127.30.15.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.125.keytab
--principal=oryx/127.30.15.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:37123,127.30.15.125:36849
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:04.259068 11307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:04.259243 11307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:04.259291 11307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:04.260370 11307 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:24:04.260404 11307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:04.260417 11307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:04.260428 11307 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:24:04.260447 11307 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:24:04.261817 11307 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:37123,127.30.15.125:36849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.125.keytab
--principal=oryx/127.30.15.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.125:36849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.15.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
W20260812 06:24:04.261925 11307 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.30.15.126:37123,127.30.15.125:36849'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 06:24:04.262023 11307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:04.262189 11307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:04.266719 11324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:04.266737 11318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:04.266737 11327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:04.266880 11307 server_base.cc:1034] running on GCE node
I20260812 06:24:04.267107 11307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:04.267380 11307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:04.268532 11307 hybrid_clock.cc:648] HybridClock initialized: now 1786515844268516 us; error 33 us; skew 500 ppm
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:04.270851 11307 init.cc:377] Logged in from keytab as oryx/127.30.15.125@KRBTEST.COM (short username oryx)
I20260812 06:24:04.271202 11307 webserver.cc:460] Webserver started at http://127.30.15.125:41679/ using document root <none> and password file <none>
I20260812 06:24:04.271440 11307 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:04.271485 11307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:04.271574 11307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:04.272512 11307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data/instance:
uuid: "1a72f31e5bc8404f9683326f3d2fb9dc"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "108776dc6500a28b97dbc114503faa58"
server_key_iv: "b0d39efe8ca3d9a90ad1da7fdd995ddc"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.272802 11307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/wal/instance:
uuid: "1a72f31e5bc8404f9683326f3d2fb9dc"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "108776dc6500a28b97dbc114503faa58"
server_key_iv: "b0d39efe8ca3d9a90ad1da7fdd995ddc"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.273972 11307 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 06:24:04.274616 11344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.274766 11307 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:04.274837 11307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/wal
uuid: "1a72f31e5bc8404f9683326f3d2fb9dc"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "108776dc6500a28b97dbc114503faa58"
server_key_iv: "b0d39efe8ca3d9a90ad1da7fdd995ddc"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.274885 11307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:04.283793 11307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:04.285348 11307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:04.285442 11307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:04.289079 11307 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.125:36849
I20260812 06:24:04.289114 11432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.125:36849 every 8 connection(s)
I20260812 06:24:04.289389 11307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
I20260812 06:24:04.290336 11433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:04.291805 11433 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.125@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:04.299393 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.292417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54202 (local address 127.30.15.126:37123)
0812 06:24:04.292471 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.292473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.292637 (+ 164us) server_negotiation.cc:407] Connection header received
0812 06:24:04.293075 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.293077 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.293090 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.293141 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.293692 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.294181 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.295123 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.295372 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.295428 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.297284 (+ 1856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.297286 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.297286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.297292 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.298319 (+ 1027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.298648 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.298649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.298649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.298692 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.298846 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.298846 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.298847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.298975 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.299023 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.299217 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.299305 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:24:04.299471 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 11307
I20260812 06:24:04.299566 11435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.292388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54202)
0812 06:24:04.292533 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.292566 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.292981 (+ 415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.293199 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.293202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.293431 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.293606 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.293610 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.294262 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.294264 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.295041 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.295043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.295444 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.295445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.295557 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.295918 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.295925 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.297201 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.298389 (+ 1188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.298395 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.298397 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.298593 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.298727 (+ 134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.298727 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.298727 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.298807 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.299019 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.299022 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.299126 (+ 104us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.299199 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.299344 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":72,"threads_started":1}
I20260812 06:24:04.300262 11433 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.125@KRBTEST.COM for oryx/127.30.15.125@KRBTEST.COM
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.15.125@KRBTEST.COM
I20260812 06:24:04.306542 11435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.300459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:36849 (local address 127.0.0.1:45932)
0812 06:24:04.300499 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.300507 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.300546 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.300724 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.300725 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.300854 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.300912 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.300913 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.301701 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.301702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.302181 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.302182 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.302612 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.302613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.302675 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.302961 (+ 286us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.302965 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.304053 (+ 1088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.305638 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.305639 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.305639 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.305778 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.305962 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.305963 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.305963 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.306015 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.306253 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.306254 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.306291 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.306351 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.306443 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 06:24:04.306620 11440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.300511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45932 (local address 127.30.15.125:36849)
0812 06:24:04.300631 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.300632 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.300636 (+ 4us) server_negotiation.cc:407] Connection header received
0812 06:24:04.300647 (+ 11us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.300648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.300653 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.300693 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.300978 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.301628 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.302246 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.302551 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.302605 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.304134 (+ 1529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.304141 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.304142 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.304147 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.305566 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.305842 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.305845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.305845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.305910 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.306071 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.306072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.306072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.306196 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.306261 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.306387 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.306495 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":108,"thread_start_us":86,"threads_started":1}
I20260812 06:24:04.307819 11433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: Bootstrap starting.
I20260812 06:24:04.308007 11438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.299903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45916 (local address 127.30.15.125:36849)
0812 06:24:04.300077 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.300081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.300153 (+ 72us) server_negotiation.cc:407] Connection header received
0812 06:24:04.300209 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.300211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.300224 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.300295 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.301122 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.301637 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.302343 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.302551 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.302603 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.304969 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.304971 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.304971 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.304978 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.306961 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.307277 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.307278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.307278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.307333 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.307504 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.307505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.307505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.307610 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.307735 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.307810 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.307879 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":141,"thread_start_us":76,"threads_started":1}
I20260812 06:24:04.308511 11433 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:04.308769 11433 log.cc:824] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:04.309425 11433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: No bootstrap required, opened a new log
I20260812 06:24:04.310779 11433 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } }
I20260812 06:24:04.310896 11433 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:04.310930 11433 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a72f31e5bc8404f9683326f3d2fb9dc, State: Initialized, Role: FOLLOWER
I20260812 06:24:04.311043 11433 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } }
I20260812 06:24:04.311357 11433 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:24:04.311318 11446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } } }
I20260812 06:24:04.311414 11446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:24:04.312880 11466 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:24:04.312935 11466 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:24:04.314211 11307 master_runner.cc:428] Detected that this master 1a72f31e5bc8404f9683326f3d2fb9dc is joining an existing cluster
I20260812 06:24:04.314249 11307 master_runner.cc:432] Initiating AddMaster RPC to add 127.30.15.125:36849
I20260812 06:24:04.320825 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.315062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54208 (local address 127.30.15.126:37123)
0812 06:24:04.315094 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.315096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.315214 (+ 118us) server_negotiation.cc:407] Connection header received
0812 06:24:04.315291 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.315292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.315301 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.315347 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.315746 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.316215 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.317254 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.317523 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.317561 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.318515 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.318516 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.318517 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.318523 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.319740 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.320073 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.320074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.320074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.320141 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.320319 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.320320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.320320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.320425 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.320481 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.320669 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.320734 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:24:04.320839 11480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.315008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54208)
0812 06:24:04.315156 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.315165 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.315214 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.315390 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.315390 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.315585 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.315659 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.315661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.316286 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.316286 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.317163 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.317165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.317627 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.317628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.317712 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.318062 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.318066 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.318418 (+ 352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.319810 (+ 1392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.319811 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.319812 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.319997 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.320206 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.320207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.320207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.320256 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.320480 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.320481 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.320546 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.320632 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.320740 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":97,"threads_started":1}
I20260812 06:24:04.321995 11438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.315370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45934 (local address 127.30.15.125:36849)
0812 06:24:04.315411 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.315413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.315423 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:24:04.315440 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.315441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.315450 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.315505 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.315781 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.316467 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.317412 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.317734 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.317800 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.318617 (+ 817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.318618 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.318619 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.318625 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.320940 (+ 2315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.321275 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.321276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.321277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.321328 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.321503 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.321505 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.321505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.321638 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.321709 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.321851 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.321941 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:24:04.322265 11481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.315218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:36849 (local address 127.0.0.1:45934)
0812 06:24:04.315352 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.315360 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.315395 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.315506 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.315506 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.315664 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.315715 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.315716 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.316568 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.316569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.317334 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.317335 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.317805 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.317805 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.317866 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.318215 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.318220 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.318544 (+ 324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.321017 (+ 2473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.321018 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.321019 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.321205 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.321385 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.321385 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.321386 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.321433 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.321703 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.321703 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.321746 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.322082 (+ 336us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.322165 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515843, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.126@KRBTEST.COM for oryx/127.30.15.125@KRBTEST.COM
I20260812 06:24:04.329650 11438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.323016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45942 (local address 127.30.15.125:36849)
0812 06:24:04.323059 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.323061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.323151 (+ 90us) server_negotiation.cc:407] Connection header received
0812 06:24:04.323223 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.323223 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.323230 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.323308 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.323773 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.324205 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.325256 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.325428 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.325481 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.327476 (+ 1995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.327477 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.327477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.327483 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.328617 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.329013 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.329014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.329014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.329064 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.329233 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.329233 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.329234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.329318 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.329363 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.329525 (+ 162us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.329584 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:24:04.329746 11484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.322938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:36849 (local address 127.0.0.1:45942)
0812 06:24:04.323052 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.323089 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.323162 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.323317 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.323320 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.323647 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.323703 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.323705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.324274 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.324275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.325174 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.325177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.325493 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.325493 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.325583 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.325932 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.325936 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.327402 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.328683 (+ 1281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.328690 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.328693 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.328948 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.329114 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.329115 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.329115 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.329178 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.329370 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.329382 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.329431 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.329512 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.329643 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":63,"threads_started":1}
I20260812 06:24:04.330298 10397 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.30.15.125:36849: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc"
member_type: NON_VOTER
last_known_addr {
host: "127.30.15.125"
port: 36849
}
attrs {
promote: true
}
}
dest_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd"
cas_config_opid_index: -1
I20260812 06:24:04.330601 10397 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true } }
I20260812 06:24:04.331039 11488 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 1a72f31e5bc8404f9683326f3d2fb9dc (127.30.15.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true } } }
I20260812 06:24:04.331327 11389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:04.332039 11389 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 FOLLOWER]: Refusing update from remote peer 1b50c6b548aa4ff5b3a6e46f491d44bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 06:24:04.332322 11485 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:04.332393 11488 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.30.15.125:36849
I20260812 06:24:04.332551 11488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true } } }
I20260812 06:24:04.332618 11488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:04.332675 11307 master.cc:537] Master@127.30.15.125:36849 shutting down...
W20260812 06:24:04.332989 10369 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 06:24:04.333364 10369 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd -> Peer 1a72f31e5bc8404f9683326f3d2fb9dc (127.30.15.125:36849): Couldn't send request to peer 1a72f31e5bc8404f9683326f3d2fb9dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:24:04.335239 11307 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:04.335367 11307 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:04.335415 11307 tablet_replica.cc:330] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: stopping tablet replica
I20260812 06:24:04.347656 11307 master.cc:552] Master@127.30.15.125:36849 shutdown complete.
I20260812 06:24:04.347693 11307 master_runner.cc:305] Clearing existing system tablet
I20260812 06:24:04.347803 11307 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:04.347842 11307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:04.348366 11307 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:04.348774 11497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.348914 11307 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:04.348966 11307 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.348989 11307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/wal
uuid: "1a72f31e5bc8404f9683326f3d2fb9dc"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "108776dc6500a28b97dbc114503faa58"
server_key_iv: "b0d39efe8ca3d9a90ad1da7fdd995ddc"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.349536 11307 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:04.350740 11307 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 06:24:04.350804 11307 log.cc:1196] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 06:24:04.350972 11307 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: Deleting consensus metadata
I20260812 06:24:04.351078 11307 master_runner.cc:315] Copying system tablet from 127.30.15.126:37123
I20260812 06:24:04.351634 11307 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: tablet copy: Beginning tablet copy session from remote peer at address 127.30.15.126:37123
I20260812 06:24:04.356760 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.351931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54218 (local address 127.30.15.126:37123)
0812 06:24:04.351968 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.351970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.352071 (+ 101us) server_negotiation.cc:407] Connection header received
0812 06:24:04.352131 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.352132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.352142 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.352186 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.352466 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.352928 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.353605 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.353800 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.353852 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.354646 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.354647 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.354648 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.354654 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.355821 (+ 1167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.356109 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.356110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.356110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.356160 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.356318 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.356318 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.356319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.356417 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.356471 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.356608 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.356673 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:24:04.356774 11511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.351901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54218)
0812 06:24:04.352009 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.352019 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.352077 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.352189 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.352190 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.352337 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.352405 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.352407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.352994 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.352995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.353524 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.353533 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.353857 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.353859 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.353924 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.354314 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.354317 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.354573 (+ 256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.355892 (+ 1319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.355892 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.355893 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.356050 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.356213 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.356214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.356214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.356268 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.356470 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.356471 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.356514 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.356579 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.356675 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":67,"threads_started":1}
I20260812 06:24:04.357000 10433 tablet_copy_service.cc:140] P 1b50c6b548aa4ff5b3a6e46f491d44bd: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 1a72f31e5bc8404f9683326f3d2fb9dc ({username='oryx', principal='oryx/127.30.15.125@KRBTEST.COM'} at 127.0.0.1:54218)
I20260812 06:24:04.357072 10433 tablet_copy_service.cc:161] P 1b50c6b548aa4ff5b3a6e46f491d44bd: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 1a72f31e5bc8404f9683326f3d2fb9dc at {username='oryx', principal='oryx/127.30.15.125@KRBTEST.COM'} at 127.0.0.1:54218: session id = 1a72f31e5bc8404f9683326f3d2fb9dc-00000000000000000000000000000000
I20260812 06:24:04.357623 10433 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:24:04.358145 11307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 06:24:04.359056 11307 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: tablet copy: Starting download of 0 data blocks...
I20260812 06:24:04.359179 11307 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: tablet copy: Starting download of 1 WAL segments...
I20260812 06:24:04.359941 11307 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:24:04.360594 10433 tablet_copy_service.cc:342] P 1b50c6b548aa4ff5b3a6e46f491d44bd: Request end of tablet copy session 1a72f31e5bc8404f9683326f3d2fb9dc-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.30.15.125@KRBTEST.COM'} at 127.0.0.1:54218
I20260812 06:24:04.360646 10433 tablet_copy_service.cc:433] P 1b50c6b548aa4ff5b3a6e46f491d44bd: ending tablet copy session 1a72f31e5bc8404f9683326f3d2fb9dc-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 1a72f31e5bc8404f9683326f3d2fb9dc
I20260812 06:24:04.362980 11307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:04.364039 11513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:04.364071 11514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:04.364157 11521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:04.367414 11307 server_base.cc:1034] running on GCE node
I20260812 06:24:04.367506 11307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:04.367624 11307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:04.368736 11307 hybrid_clock.cc:648] HybridClock initialized: now 1786515844368730 us; error 24 us; skew 500 ppm
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:04.369827 11307 init.cc:377] Logged in from keytab as oryx/127.30.15.125@KRBTEST.COM (short username oryx)
I20260812 06:24:04.370051 11307 webserver.cc:460] Webserver started at http://127.30.15.125:42603/ using document root <none> and password file <none>
I20260812 06:24:04.370158 11307 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:04.370191 11307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:04.370719 11307 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.371171 11533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.371308 11307 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.371366 11307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/wal
uuid: "1a72f31e5bc8404f9683326f3d2fb9dc"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "108776dc6500a28b97dbc114503faa58"
server_key_iv: "b0d39efe8ca3d9a90ad1da7fdd995ddc"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.371415 11307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:04.391208 11307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:04.392742 11307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:04.396078 11307 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.125:36849
I20260812 06:24:04.396113 11642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.125:36849 every 8 connection(s)
I20260812 06:24:04.396401 11307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
I20260812 06:24:04.397046 11643 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:24:04.397410 11643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: Bootstrap starting.
I20260812 06:24:04.399550 11643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:24:04.399734 11643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: Bootstrap complete.
I20260812 06:24:04.399901 11643 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true } }
I20260812 06:24:04.399964 11643 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1a72f31e5bc8404f9683326f3d2fb9dc, State: Initialized, Role: LEARNER
I20260812 06:24:04.399999 11643 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true } }
I20260812 06:24:04.400178 11643 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:24:04.400161 11647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true } } }
I20260812 06:24:04.400239 11647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: This master's current role is: LEARNER
I20260812 06:24:04.401476 11666 catalog_manager.cc:1259] Loaded cluster ID: f6cc4d2708c047ca83dc22b2c1e38414
I20260812 06:24:04.401515 11666 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: loading cluster ID for follower catalog manager: success
I20260812 06:24:04.402381 11666 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: acquiring CA information for follower catalog manager: success
I20260812 06:24:04.402640 11666 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:24:04.415706 11667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.409324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45948 (local address 127.30.15.125:36849)
0812 06:24:04.409449 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.409451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.409462 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:24:04.409487 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.409488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.409498 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.409579 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.410034 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.411045 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.411784 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.412107 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.412186 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.413233 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.413234 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.413235 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.413242 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.414696 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.415006 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.415007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.415007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.415074 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.415214 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.415215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.415215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.415352 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.415446 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.415536 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.415617 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":62,"threads_started":1}
WARNING: no policy specified for oryx/127.30.15.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.124@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.124.keytab.
Entry for principal oryx/127.30.15.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.124.keytab.
I20260812 06:24:04.440312 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.124:36653
--webserver_interface=127.30.15.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.124.keytab
--principal=oryx/127.30.15.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:37123,127.30.15.125:36849,127.30.15.124:36653
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:04.521360 11675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:04.521536 11675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:04.521565 11675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:04.522666 11675 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:24:04.522704 11675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:04.522723 11675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:04.522737 11675 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:24:04.522754 11675 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:24:04.524257 11675 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:37123,127.30.15.125:36849,127.30.15.124:36653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.124.keytab
--principal=oryx/127.30.15.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.124:36653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.15.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:04.524477 11675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:04.524672 11675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:04.529263 11685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:04.529346 11689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:04.529423 11675 server_base.cc:1034] running on GCE node
W20260812 06:24:04.529346 11686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:04.529724 11675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:04.529965 11675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:04.531095 11675 hybrid_clock.cc:648] HybridClock initialized: now 1786515844531086 us; error 30 us; skew 500 ppm
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:04.533409 11675 init.cc:377] Logged in from keytab as oryx/127.30.15.124@KRBTEST.COM (short username oryx)
I20260812 06:24:04.533811 11675 webserver.cc:460] Webserver started at http://127.30.15.124:38159/ using document root <none> and password file <none>
I20260812 06:24:04.534011 11675 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:04.534060 11675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:04.534169 11675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:04.535089 11675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data/instance:
uuid: "f9a47aacfa234b9b850ae755b87ce90d"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "edca5a83c21666ad022eb7b9c1387916"
server_key_iv: "13d2c22880c45e743a588f642375df88"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.535434 11675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/wal/instance:
uuid: "f9a47aacfa234b9b850ae755b87ce90d"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "edca5a83c21666ad022eb7b9c1387916"
server_key_iv: "13d2c22880c45e743a588f642375df88"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.538023 11675 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260812 06:24:04.538717 11701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.538885 11675 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:04.538973 11675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/wal
uuid: "f9a47aacfa234b9b850ae755b87ce90d"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "edca5a83c21666ad022eb7b9c1387916"
server_key_iv: "13d2c22880c45e743a588f642375df88"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.539028 11675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:04.557370 11675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:04.559034 11675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:04.559139 11675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:04.562883 11675 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.124:36653
I20260812 06:24:04.562915 11809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.124:36653 every 8 connection(s)
I20260812 06:24:04.563215 11675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
I20260812 06:24:04.564252 11812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:04.564864 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 11675
I20260812 06:24:04.566315 11812 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.124@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.15.124@KRBTEST.COM
I20260812 06:24:04.574757 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.567114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54228 (local address 127.30.15.126:37123)
0812 06:24:04.567170 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.567171 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.567238 (+ 67us) server_negotiation.cc:407] Connection header received
0812 06:24:04.567303 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.567304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.567315 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.567376 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.567793 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.568452 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.569539 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.569811 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.569863 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.572125 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.572127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.572128 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.572135 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.573463 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.573824 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.573825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.573825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.573886 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.574134 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.574135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.574135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.574251 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.574320 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.574585 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.574670 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:24:04.574913 11819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.566955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54228)
0812 06:24:04.567149 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.567186 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.567238 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.567391 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.567393 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.567626 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.567716 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.567720 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.568542 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.568543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.569471 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.569473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.569910 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.569911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.569969 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.570262 (+ 293us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.570271 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.572042 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.573535 (+ 1493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.573543 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.573545 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.573758 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.573938 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.573939 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.573939 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.574075 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.574318 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.574323 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.574451 (+ 128us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.574552 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.574671 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":84,"threads_started":1}
I20260812 06:24:04.575423 11818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.565588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41240 (local address 127.30.15.124:36653)
0812 06:24:04.565764 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.565772 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.565797 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:24:04.566200 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.566205 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.566248 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.566356 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.567075 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.568266 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.569248 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.569648 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.569751 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.572554 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.572563 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.572563 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.572570 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.573946 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.574283 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.574286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.574287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.574345 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.574522 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.574522 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.574523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.574677 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.574806 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.575219 (+ 413us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.575321 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":85,"threads_started":1}
I20260812 06:24:04.575451 11812 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.124@KRBTEST.COM for oryx/127.30.15.125@KRBTEST.COM
I20260812 06:24:04.580744 11819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.575683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:36849 (local address 127.0.0.1:45950)
0812 06:24:04.575716 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.575726 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.575766 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.575880 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.575881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.575985 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.576044 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.576046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.576633 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.576633 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.577104 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.577105 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.577415 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.577416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.577469 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.577742 (+ 273us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.577746 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.578753 (+ 1007us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.579985 (+ 1232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.579985 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.579986 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.580139 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.580275 (+ 136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.580276 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.580276 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.580316 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.580502 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.580503 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.580542 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.580613 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.580687 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260812 06:24:04.580750 11667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.575740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45950 (local address 127.30.15.125:36849)
0812 06:24:04.575779 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.575780 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.575787 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:24:04.575812 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.575813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.575825 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.575878 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.576114 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.576578 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.577158 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.577347 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.577393 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.578831 (+ 1438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.578833 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.578833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.578840 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.579922 (+ 1082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.580192 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.580192 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.580192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.580234 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.580348 (+ 114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.580349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.580349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.580432 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.580473 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.580631 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.580690 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:24:04.581091 11812 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.124@KRBTEST.COM for oryx/127.30.15.124@KRBTEST.COM
I20260812 06:24:04.586270 11819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.581300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36653 (local address 127.0.0.1:41256)
0812 06:24:04.581339 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.581349 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.581392 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.581480 (+ 88us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.581480 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.581582 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.581608 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.581609 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.582170 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.582171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.582635 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.582637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.582927 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.582928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.582976 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.583328 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.583333 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.584333 (+ 1000us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.585453 (+ 1120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.585454 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.585454 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.585603 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.585774 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.585774 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.585775 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.585826 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.586070 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.586071 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.586102 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.586149 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.586218 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 06:24:04.586345 11818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.581328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41256 (local address 127.30.15.124:36653)
0812 06:24:04.581354 (+ 26us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.581356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.581380 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:24:04.581430 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.581430 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.581437 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.581475 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.581650 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.582089 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.582699 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.582873 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.582911 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.584402 (+ 1491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.584403 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.584403 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.584409 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.585376 (+ 967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.585664 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.585665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.585665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.585723 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.585908 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.585909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.585909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.586017 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.586073 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.586172 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.586273 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":13}
I20260812 06:24:04.587754 11812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: Bootstrap starting.
I20260812 06:24:04.588310 11812 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:04.588564 11812 log.cc:824] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:04.589223 11812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: No bootstrap required, opened a new log
I20260812 06:24:04.590567 11812 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } }
I20260812 06:24:04.590687 11812 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:04.590718 11812 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9a47aacfa234b9b850ae755b87ce90d, State: Initialized, Role: FOLLOWER
I20260812 06:24:04.590831 11812 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } }
I20260812 06:24:04.591068 11821 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } } }
I20260812 06:24:04.591112 11812 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:24:04.591158 11821 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:24:04.592657 11840 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:24:04.592703 11840 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:24:04.594724 11675 master_runner.cc:428] Detected that this master f9a47aacfa234b9b850ae755b87ce90d is joining an existing cluster
I20260812 06:24:04.594767 11675 master_runner.cc:432] Initiating AddMaster RPC to add 127.30.15.124:36653
I20260812 06:24:04.602074 11853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.595668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36653 (local address 127.0.0.1:41272)
0812 06:24:04.596007 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.596085 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.596144 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.596281 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.596282 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.596455 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.596523 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.596525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.597299 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.597300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.598154 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.598156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.598596 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.598597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.598652 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.599001 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.599006 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.599429 (+ 423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.601196 (+ 1767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.601197 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.601197 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.601350 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.601537 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.601537 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.601537 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.601589 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.601821 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.601821 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.601852 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.601927 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.602004 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":2,"thread_start_us":101,"threads_started":1}
I20260812 06:24:04.602290 11818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.595861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41272 (local address 127.30.15.124:36653)
0812 06:24:04.595909 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.595910 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.596126 (+ 216us) server_negotiation.cc:407] Connection header received
0812 06:24:04.596201 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.596202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.596211 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.596273 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.596596 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.597226 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.598232 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.598495 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.598526 (+ 31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.599748 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.599749 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.599749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.599756 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.601127 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.601417 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.601418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.601418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.601475 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.601633 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.601634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.601634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.601765 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.601829 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.601963 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.602073 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":33}
I20260812 06:24:04.614248 11667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.596049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45958 (local address 127.30.15.125:36849)
0812 06:24:04.596107 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.596109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.596532 (+ 423us) server_negotiation.cc:407] Connection header received
0812 06:24:04.596623 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.596624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.596634 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.596660 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.597005 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.597691 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.598632 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.599131 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.599177 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.611630 (+ 12453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.611632 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.611632 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.611639 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.613079 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.613446 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.613448 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.613448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.613510 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.613729 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.613730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.613731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.613862 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.613946 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.614082 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.614163 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:24:04.614251 11851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.595892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:36849 (local address 127.0.0.1:45958)
0812 06:24:04.596478 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.596488 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.596556 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.596712 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.596713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.596868 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.596925 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.596926 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.597777 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.597777 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.598549 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.598551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.599288 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.599290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.599356 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.599733 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.599737 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.611520 (+ 11783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.613168 (+ 1648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.613169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.613169 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.613370 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.613598 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.613599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.613599 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.613665 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.613942 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.613942 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.613982 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.614055 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.614149 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":67,"threads_started":1}
I20260812 06:24:04.614933 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.595684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54230 (local address 127.30.15.126:37123)
0812 06:24:04.595722 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.595724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.595880 (+ 156us) server_negotiation.cc:407] Connection header received
0812 06:24:04.596009 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.596010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.596021 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.596048 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.596448 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.597174 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.598263 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.598551 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.598592 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.612361 (+ 13769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.612362 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.612362 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.612370 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.613689 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.614011 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.614012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.614012 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.614068 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.614259 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.614260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.614260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.614383 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.614427 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.614780 (+ 353us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.614847 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:24:04.614964 11852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.595659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54230)
0812 06:24:04.595818 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.595828 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.595939 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.596111 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.596111 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.596282 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.596364 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.596366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.597269 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.597270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.598166 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.598169 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.598663 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.598664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.598727 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.611883 (+ 13156us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.611887 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.612236 (+ 349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.613769 (+ 1533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.613770 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.613770 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.613959 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.614135 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.614136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.614136 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.614193 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.614642 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.614642 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.614689 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.614752 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.614847 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":104,"threads_started":1}
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515843, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.126@KRBTEST.COM for oryx/127.30.15.124@KRBTEST.COM
I20260812 06:24:04.622361 11484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.616653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36653 (local address 127.0.0.1:41282)
0812 06:24:04.616699 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.616708 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.616753 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.616865 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.616866 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.617002 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.617037 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.617038 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.617702 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.617703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.618209 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.618211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.618556 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.618557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.618621 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.618941 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.618946 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.620083 (+ 1137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.621558 (+ 1475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.621559 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.621559 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.621711 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.621882 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.621882 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.621883 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.621934 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.622153 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.622153 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.622186 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.622231 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.622301 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 06:24:04.622399 11818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.616713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41282 (local address 127.30.15.124:36653)
0812 06:24:04.616752 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.616754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.616762 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:04.616811 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.616812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.616820 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.616863 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.617097 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.617627 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.618277 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.618496 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.618548 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.620158 (+ 1610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.620160 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.620160 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.620166 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.621471 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.621769 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.621770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.621770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.621822 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.621981 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.621982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.621982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.622100 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.622162 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.622253 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.622319 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:24:04.622901 10397 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.30.15.124:36653: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d"
member_type: NON_VOTER
last_known_addr {
host: "127.30.15.124"
port: 36653
}
attrs {
promote: true
}
}
dest_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd"
cas_config_opid_index: 5
I20260812 06:24:04.623126 10397 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } }
I20260812 06:24:04.623526 11489 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER f9a47aacfa234b9b850ae755b87ce90d (127.30.15.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:04.624293 11489 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.30.15.124:36653
I20260812 06:24:04.624373 11485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:04.624446 11485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:04.624536 11762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:04.625168 11762 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 FOLLOWER]: Refusing update from remote peer 1b50c6b548aa4ff5b3a6e46f491d44bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 06:24:04.625432 11675 master.cc:537] Master@127.30.15.124:36653 shutting down...
I20260812 06:24:04.625438 11485 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:24:04.626080 10373 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd -> Peer f9a47aacfa234b9b850ae755b87ce90d (127.30.15.124:36653): Couldn't send request to peer f9a47aacfa234b9b850ae755b87ce90d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:24:04.628587 11675 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:04.628674 11675 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:04.628722 11675 tablet_replica.cc:330] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: stopping tablet replica
I20260812 06:24:04.629735 11484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.623533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:36849 (local address 127.0.0.1:45960)
0812 06:24:04.623613 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.623622 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.623657 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.626760 (+ 3103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.626761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.626763 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:04.626795 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.626797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.627555 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.627556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.628683 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.628686 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.629499 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.629500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.629565 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.629589 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.629639 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.629674 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 06:24:04.630069 11667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.623622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45960 (local address 127.30.15.125:36849)
0812 06:24:04.626591 (+ 2969us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.626593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.626601 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:04.626622 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.626623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.626647 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.626704 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:04.626850 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.627464 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.628775 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.629317 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.629385 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.629463 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.629970 (+ 507us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.630008 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2948}
I20260812 06:24:04.630272 11597 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 LEARNER]: Refusing update from remote peer 1b50c6b548aa4ff5b3a6e46f491d44bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 06:24:04.630496 11485 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 06:24:04.631121 11675 master.cc:552] Master@127.30.15.124:36653 shutdown complete.
I20260812 06:24:04.631163 11675 master_runner.cc:305] Clearing existing system tablet
I20260812 06:24:04.631124 11597 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER f9a47aacfa234b9b850ae755b87ce90d (127.30.15.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:04.631306 11675 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:04.631347 11675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:04.631865 11675 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.632237 11858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:04.632336 11858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: This master's current role is: LEARNER
I20260812 06:24:04.632390 11485 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd: attempting to promote NON_VOTER 1a72f31e5bc8404f9683326f3d2fb9dc to VOTER
I20260812 06:24:04.632388 11647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b50c6b548aa4ff5b3a6e46f491d44bd. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: NON_VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: true } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:04.632484 11647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: This master's current role is: LEARNER
I20260812 06:24:04.632557 11485 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } }
I20260812 06:24:04.632907 11861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.632936 11597 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 LEARNER]: Refusing update from remote peer 1b50c6b548aa4ff5b3a6e46f491d44bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 06:24:04.632969 11484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.632856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36653 (local address 127.0.0.1:41302)
0812 06:24:04.632892 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.632943 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 06:24:04.633082 11675 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:04.633088 11488 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 06:24:04.633131 11675 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:24:04.633152 11675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/wal
uuid: "f9a47aacfa234b9b850ae755b87ce90d"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "edca5a83c21666ad022eb7b9c1387916"
server_key_iv: "13d2c22880c45e743a588f642375df88"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.633309 11484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.633241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36653 (local address 127.0.0.1:41306)
0812 06:24:04.633269 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.633288 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260812 06:24:04.633358 10373 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd -> Peer f9a47aacfa234b9b850ae755b87ce90d (127.30.15.124:36653): Couldn't send request to peer f9a47aacfa234b9b850ae755b87ce90d. Status: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36653: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:24:04.633657 11488 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 1a72f31e5bc8404f9683326f3d2fb9dc (127.30.15.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:04.633895 11675 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:04.634496 11488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:04.634577 11488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:04.634629 11488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:04.634682 11488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:04.634915 11597 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 1a72f31e5bc8404f9683326f3d2fb9dc (127.30.15.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:04.635157 11675 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 06:24:04.635228 11675 log.cc:1196] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 06:24:04.635444 11675 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: Deleting consensus metadata
I20260812 06:24:04.635561 11675 master_runner.cc:315] Copying system tablet from 127.30.15.126:37123
I20260812 06:24:04.635836 11647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:04.635918 11647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:24:04.636183 11675 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: tablet copy: Beginning tablet copy session from remote peer at address 127.30.15.126:37123
I20260812 06:24:04.641788 11874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.636417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54234)
0812 06:24:04.636537 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.636545 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.636596 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.636704 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.636705 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.636839 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.636885 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.636886 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.637756 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.637757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.638266 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.638268 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.638693 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.638694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.638738 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.639122 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.639126 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.639427 (+ 301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.640911 (+ 1484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.640911 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.640912 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.641068 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.641254 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.641255 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.641255 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.641320 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.641558 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.641558 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.641592 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.641637 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.641707 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":52,"threads_started":1}
I20260812 06:24:04.641824 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.636470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54234 (local address 127.30.15.126:37123)
0812 06:24:04.636506 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.636507 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.636605 (+ 98us) server_negotiation.cc:407] Connection header received
0812 06:24:04.636630 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.636631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.636640 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.636701 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.636955 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.637675 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.638340 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.638629 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.638696 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.639501 (+ 805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.639502 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.639502 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.639509 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.640814 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.641132 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.641132 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.641133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.641190 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.641384 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.641385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.641385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.641503 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.641569 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.641663 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.641733 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:24:04.641994 10433 tablet_copy_service.cc:140] P 1b50c6b548aa4ff5b3a6e46f491d44bd: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer f9a47aacfa234b9b850ae755b87ce90d ({username='oryx', principal='oryx/127.30.15.124@KRBTEST.COM'} at 127.0.0.1:54234)
I20260812 06:24:04.642053 10433 tablet_copy_service.cc:161] P 1b50c6b548aa4ff5b3a6e46f491d44bd: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer f9a47aacfa234b9b850ae755b87ce90d at {username='oryx', principal='oryx/127.30.15.124@KRBTEST.COM'} at 127.0.0.1:54234: session id = f9a47aacfa234b9b850ae755b87ce90d-00000000000000000000000000000000
I20260812 06:24:04.642554 10433 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 06:24:04.642985 11675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 06:24:04.643918 11675 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: tablet copy: Starting download of 0 data blocks...
I20260812 06:24:04.644047 11675 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: tablet copy: Starting download of 1 WAL segments...
I20260812 06:24:04.644780 11675 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 06:24:04.645483 10433 tablet_copy_service.cc:342] P 1b50c6b548aa4ff5b3a6e46f491d44bd: Request end of tablet copy session f9a47aacfa234b9b850ae755b87ce90d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.30.15.124@KRBTEST.COM'} at 127.0.0.1:54234
I20260812 06:24:04.645527 10433 tablet_copy_service.cc:433] P 1b50c6b548aa4ff5b3a6e46f491d44bd: ending tablet copy session f9a47aacfa234b9b850ae755b87ce90d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer f9a47aacfa234b9b850ae755b87ce90d
I20260812 06:24:04.647888 11675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:04.648862 11876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:04.648950 11877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:04.648972 11883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:04.651571 11675 server_base.cc:1034] running on GCE node
I20260812 06:24:04.651665 11675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:04.651785 11675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:04.652902 11675 hybrid_clock.cc:648] HybridClock initialized: now 1786515844652891 us; error 31 us; skew 500 ppm
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:04.654004 11675 init.cc:377] Logged in from keytab as oryx/127.30.15.124@KRBTEST.COM (short username oryx)
I20260812 06:24:04.654228 11675 webserver.cc:460] Webserver started at http://127.30.15.124:46747/ using document root <none> and password file <none>
I20260812 06:24:04.654332 11675 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:04.654367 11675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:04.654904 11675 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.655438 11897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.655551 11675 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.655592 11675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/wal
uuid: "f9a47aacfa234b9b850ae755b87ce90d"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "edca5a83c21666ad022eb7b9c1387916"
server_key_iv: "13d2c22880c45e743a588f642375df88"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.655638 11675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:04.682073 11675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:04.683568 11675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:04.685877 11675 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.124:36653
I20260812 06:24:04.685913 11983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.124:36653 every 8 connection(s)
I20260812 06:24:04.686128 11675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
I20260812 06:24:04.686709 11984 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:24:04.687065 11984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: Bootstrap starting.
I20260812 06:24:04.689218 11984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:24:04.689407 11984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: Bootstrap complete.
I20260812 06:24:04.689572 11984 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } }
I20260812 06:24:04.689638 11984 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f9a47aacfa234b9b850ae755b87ce90d, State: Initialized, Role: LEARNER
I20260812 06:24:04.689672 11984 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } }
I20260812 06:24:04.689829 11984 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:24:04.689848 11988 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:04.689980 11988 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: This master's current role is: LEARNER
I20260812 06:24:04.691227 12012 catalog_manager.cc:1259] Loaded cluster ID: f6cc4d2708c047ca83dc22b2c1e38414
I20260812 06:24:04.691291 12012 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: loading cluster ID for follower catalog manager: success
I20260812 06:24:04.692368 12012 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: acquiring CA information for follower catalog manager: success
I20260812 06:24:04.692634 12012 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:24:04.738631 12013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.733235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41336 (local address 127.30.15.124:36653)
0812 06:24:04.733346 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.733347 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.733356 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:24:04.733380 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.733381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.733390 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.733453 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.734034 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.734650 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.735344 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.735524 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.735576 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.736627 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.736627 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.736628 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.736632 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.737723 (+ 1091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.738035 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.738036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.738036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.738081 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.738208 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.738209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.738209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.738297 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.738364 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.738500 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.738565 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":62,"threads_started":1}
I20260812 06:24:04.739097 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 10516
I20260812 06:24:04.746879 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:39219
--local_ip_for_outbound_sockets=127.30.15.65
--tserver_master_addrs=127.30.15.126:37123
--webserver_port=36489
--webserver_interface=127.30.15.65
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab
--principal=oryx/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.15.126:37123,127.30.15.125:36849
--tserver_master_addrs=127.30.15.126:37123,127.30.15.125:36849,127.30.15.124:36653 with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:04.828346 12015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:04.828529 12015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:04.828552 12015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:04.829707 12015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:04.829748 12015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:04.829780 12015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:24:04.831218 12015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab
--principal=oryx/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:39219
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=36489
--tserver_master_addrs=127.30.15.126:37123,127.30.15.125:36849,127.30.15.124:36653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:04.831459 12015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:04.831673 12015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:04.836354 12021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:04.836369 12026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:04.836364 12020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:04.836560 12015 server_base.cc:1034] running on GCE node
I20260812 06:24:04.836748 12015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:04.836985 12015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:04.838150 12015 hybrid_clock.cc:648] HybridClock initialized: now 1786515844838136 us; error 27 us; skew 500 ppm
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:04.840654 12015 init.cc:377] Logged in from keytab as oryx/127.30.15.65@KRBTEST.COM (short username oryx)
I20260812 06:24:04.841063 12015 webserver.cc:460] Webserver started at http://127.30.15.65:36489/ using document root <none> and password file <none>
I20260812 06:24:04.841249 12015 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:04.841308 12015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:04.842514 12015 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:04.842998 12040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.843148 12015 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.843225 12015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "ee1f7a3ad5834111bf4c2bf180750ece"
format_stamp: "Formatted at 2026-08-12 06:24:03 on dist-test-slave-gjrz"
server_key: "d3681da67e801ef6aaf2b22fac3bfb5e"
server_key_iv: "11ff4bfcdc8dd334f3db43dac1cf07ce"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.843554 12015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:04.858633 12015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:04.860661 12015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:04.860785 12015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:04.860980 12015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:04.861243 12015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:04.861274 12015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.861300 12015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:04.861325 12015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.867321 12015 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:39219
I20260812 06:24:04.867496 12249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:39219 every 8 connection(s)
I20260812 06:24:04.867692 12015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:24:04.872152 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 12015
I20260812 06:24:04.872308 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 10794
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.125@KRBTEST.COM
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.124@KRBTEST.COM
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:04.888021 11667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.868335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:54159 (local address 127.30.15.125:36849)
0812 06:24:04.868381 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.868383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.868749 (+ 366us) server_negotiation.cc:407] Connection header received
0812 06:24:04.869595 (+ 846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.869597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.869610 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.869640 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.870404 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.871170 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.872259 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.872569 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.872609 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.884590 (+ 11981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.884592 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.884593 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.884600 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.886175 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.886642 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.886643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.886644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.886704 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.886983 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.886984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.886984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.887132 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.887173 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.887874 (+ 701us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.887943 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:24:04.889074 12013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.868306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:38293 (local address 127.30.15.124:36653)
0812 06:24:04.868351 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.868352 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.868616 (+ 264us) server_negotiation.cc:407] Connection header received
0812 06:24:04.869580 (+ 964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.869582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.869596 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.869647 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.870365 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.871142 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.872130 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.872448 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.872490 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.885553 (+ 13063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.885554 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.885554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.885563 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.887079 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.887546 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.887547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.887547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.887619 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.888349 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.888350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.888350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.888692 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.888743 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.888913 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.888991 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:24:04.890031 12267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.868306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:36849 (local address 127.30.15.65:54159)
0812 06:24:04.868689 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.868697 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.869482 (+ 785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.869709 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.869713 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.870099 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.870281 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.870287 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.871233 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.871234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.872165 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.872166 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.878794 (+ 6628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.878795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.878972 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.882568 (+ 3596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.882576 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.884476 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.886265 (+ 1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.886273 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.886275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.886547 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.886774 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.886775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.886775 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.886901 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.887218 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.887224 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.887389 (+ 165us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.888418 (+ 1029us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.889762 (+ 1344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"mutex_wait_us":12,"thread_start_us":100,"threads_started":1}
I20260812 06:24:04.890394 12253 heartbeater.cc:347] Connected to a master server at 127.30.15.125:36849
I20260812 06:24:04.890478 12253 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:04.890633 12253 heartbeater.cc:511] Master 127.30.15.125:36849 requested a full tablet report, sending...
I20260812 06:24:04.890981 12258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.868306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36653 (local address 127.30.15.65:38293)
0812 06:24:04.868492 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.868536 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.869477 (+ 941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.869711 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.869713 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.870091 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.870280 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.870285 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.871328 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.871329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.872020 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.872023 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.882595 (+ 10572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.882596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.882682 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.883123 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.883129 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.885447 (+ 2318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.887161 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.887163 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.887163 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.887434 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.887707 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.887708 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.887708 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.887781 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.888776 (+ 995us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.888777 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.888813 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.890388 (+ 1575us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.890599 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":90,"threads_started":1}
I20260812 06:24:04.891052 11565 ts_manager.cc:194] Registered new tserver with Master: ee1f7a3ad5834111bf4c2bf180750ece (127.30.15.65:39219)
I20260812 06:24:04.891680 12251 heartbeater.cc:347] Connected to a master server at 127.30.15.124:36653
I20260812 06:24:04.891776 12251 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:04.891899 12251 heartbeater.cc:511] Master 127.30.15.124:36653 requested a full tablet report, sending...
I20260812 06:24:04.892023 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.868652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:39555 (local address 127.30.15.126:37123)
0812 06:24:04.868707 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:04.868709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:04.868833 (+ 124us) server_negotiation.cc:407] Connection header received
0812 06:24:04.869704 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:04.869705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:04.869717 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:04.869768 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:04.870391 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.870879 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.872292 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.872597 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.872631 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.887617 (+ 14986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:04.887618 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:04.887618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:04.887625 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:04.889256 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.891392 (+ 2136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.891393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.891393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.891460 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:04.891617 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:04.891618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:04.891618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:04.891718 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:04.891755 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:04.891887 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 06:24:04.891952 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:24:04.892243 12261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:04.868567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.65:39555)
0812 06:24:04.868783 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:04.868789 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:04.869493 (+ 704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:04.869787 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:04.869788 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:04.870108 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:04.870281 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.870287 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.870998 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.870999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.872158 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:04.872161 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:04.883209 (+ 11048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:04.883209 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:04.883291 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:04.883615 (+ 324us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:04.883620 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:04.887545 (+ 3925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:04.889356 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.889357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.889358 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.889610 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.891519 (+ 1909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:04.891520 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:04.891520 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:04.891568 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:04.891777 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:04.891777 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:04.891809 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 06:24:04.892086 (+ 277us) client_negotiation.cc:240] Negotiation successful
0812 06:24:04.892166 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":6,"thread_start_us":64,"threads_started":1}
I20260812 06:24:04.892365 11928 ts_manager.cc:194] Registered new tserver with Master: ee1f7a3ad5834111bf4c2bf180750ece (127.30.15.65:39219)
I20260812 06:24:04.896070 12252 heartbeater.cc:347] Connected to a master server at 127.30.15.126:37123
I20260812 06:24:04.896121 12252 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:04.896183 12252 heartbeater.cc:511] Master 127.30.15.126:37123 requested a full tablet report, sending...
I20260812 06:24:04.896464 10397 ts_manager.cc:194] Re-registered known tserver with Master: ee1f7a3ad5834111bf4c2bf180750ece (127.30.15.65:39219)
I20260812 06:24:04.896827 10397 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:39555
I20260812 06:24:04.900539 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:34441
--local_ip_for_outbound_sockets=127.30.15.66
--tserver_master_addrs=127.30.15.126:37123
--webserver_port=36857
--webserver_interface=127.30.15.66
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab
--principal=oryx/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.15.126:37123,127.30.15.125:36849
--tserver_master_addrs=127.30.15.126:37123,127.30.15.125:36849,127.30.15.124:36653 with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:04.980209 12268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:04.980392 12268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:04.980422 12268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:04.981537 12268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:04.981577 12268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:04.981611 12268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:24:04.983036 12268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab
--principal=oryx/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:34441
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=36857
--tserver_master_addrs=127.30.15.126:37123,127.30.15.125:36849,127.30.15.124:36653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:04.983294 12268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:04.983495 12268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:04.988080 12278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:04.988186 12274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:04.988227 12268 server_base.cc:1034] running on GCE node
W20260812 06:24:04.988109 12281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:04.988467 12268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:04.988659 12268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:04.989768 12268 hybrid_clock.cc:648] HybridClock initialized: now 1786515844989754 us; error 27 us; skew 500 ppm
Aug 12 06:24:04 dist-test-slave-gjrz krb5kdc[10314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:04.992129 12268 init.cc:377] Logged in from keytab as oryx/127.30.15.66@KRBTEST.COM (short username oryx)
I20260812 06:24:04.992514 12268 webserver.cc:460] Webserver started at http://127.30.15.66:36857/ using document root <none> and password file <none>
I20260812 06:24:04.992681 12268 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:04.992733 12268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:04.993884 12268 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:04.994403 12295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.994542 12268 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:04.994619 12268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "6f72d3405a524e20b496d9750b728db1"
format_stamp: "Formatted at 2026-08-12 06:24:03 on dist-test-slave-gjrz"
server_key: "a76cf7246f1bb5b5b7c795d76d44aee4"
server_key_iv: "e6f959bec5a736100a78b21ad7319612"
server_key_version: "encryptionkey@0"
I20260812 06:24:04.994922 12268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:05.007501 12268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:05.009112 12268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:05.009236 12268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:05.009438 12268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:05.009698 12268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:05.009732 12268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:05.009749 12268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:05.009771 12268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:05.015712 12268 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:34441
I20260812 06:24:05.015750 12497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:34441 every 8 connection(s)
I20260812 06:24:05.016052 12268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:24:05 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.124@KRBTEST.COM
Aug 12 06:24:05 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
Aug 12 06:24:05 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515844, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.125@KRBTEST.COM
I20260812 06:24:05.025302 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 12268
I20260812 06:24:05.025458 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 11063
I20260812 06:24:05.026371 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.017198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:49903 (local address 127.30.15.126:37123)
0812 06:24:05.017243 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.017245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.017313 (+ 68us) server_negotiation.cc:407] Connection header received
0812 06:24:05.017588 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.017590 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.017602 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.017630 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:05.018440 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.019178 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.020248 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.020457 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.020514 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.023227 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:05.023228 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:05.023229 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:05.023236 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:05.024712 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.025283 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.025284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.025284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.025351 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.025655 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.025655 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.025656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.025781 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:05.025823 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.026187 (+ 364us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.026275 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:24:05.026371 12013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.016703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:38407 (local address 127.30.15.124:36653)
0812 06:24:05.016758 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.016760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.016936 (+ 176us) server_negotiation.cc:407] Connection header received
0812 06:24:05.017700 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.017701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.017712 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.017766 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:05.018432 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.018933 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.020188 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.020475 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.020527 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.022763 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:05.022764 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:05.022764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:05.022771 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:05.024539 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.025284 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.025285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.025285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.025347 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.025644 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.025645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.025645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.025780 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:05.025823 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.026196 (+ 373us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.026276 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:24:05.026414 11667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.017020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:58023 (local address 127.30.15.125:36849)
0812 06:24:05.017065 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.017067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.017125 (+ 58us) server_negotiation.cc:407] Connection header received
0812 06:24:05.017569 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.017571 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.017584 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.017641 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:05.018410 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.019192 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.020110 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.020387 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.020451 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.023939 (+ 3488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:05.023940 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:05.023941 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:05.023947 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:05.025233 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.025594 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.025595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.025595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.025649 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.025820 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.025820 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.025821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.025934 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:05.025974 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.026218 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.026308 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:24:05.026947 12510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.017132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.66:49903)
0812 06:24:05.017256 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:05.017266 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:05.017481 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:05.017707 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:05.017710 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:05.018140 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:05.018322 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.018328 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.019306 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.019308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.020181 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.020183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.020568 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.020569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.020646 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.021255 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:05.021259 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:05.023110 (+ 1851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:05.024783 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:05.024784 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:05.024786 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:05.025190 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:05.025422 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:05.025423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:05.025423 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:05.025563 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:05.025872 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:05.025880 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:05.026033 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 06:24:05.026495 (+ 462us) client_negotiation.cc:240] Negotiation successful
0812 06:24:05.026701 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":40,"thread_start_us":63,"threads_started":1}
I20260812 06:24:05.026952 12509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.016939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:36849 (local address 127.30.15.66:58023)
0812 06:24:05.017065 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:05.017074 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:05.017475 (+ 401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:05.017708 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:05.017711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:05.018142 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:05.018321 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.018325 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.019296 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.019297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.020017 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.020020 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.020465 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.020466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.020594 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.021191 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:05.021195 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:05.023607 (+ 2412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:05.025322 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:05.025323 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:05.025324 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:05.025514 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:05.025710 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:05.025711 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:05.025711 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:05.025762 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:05.026020 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:05.026021 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:05.026079 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 06:24:05.026526 (+ 447us) client_negotiation.cc:240] Negotiation successful
0812 06:24:05.026788 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":164,"thread_start_us":76,"threads_started":1}
I20260812 06:24:05.027418 12507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.016670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36653 (local address 127.30.15.66:38407)
0812 06:24:05.016825 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:05.016857 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:05.017472 (+ 615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:05.017779 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:05.017780 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:05.018150 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:05.018322 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.018327 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.019039 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.019040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.020109 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.020112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.020548 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.020549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.020646 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.021170 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:05.021179 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:05.022671 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:05.024775 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:05.024783 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:05.024785 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:05.025190 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:05.025460 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:05.025461 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:05.025461 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:05.025567 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:05.025872 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:05.025880 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:05.026033 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 06:24:05.026868 (+ 835us) client_negotiation.cc:240] Negotiation successful
0812 06:24:05.026958 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":13,"thread_start_us":97,"threads_started":1}
I20260812 06:24:05.027570 12502 heartbeater.cc:347] Connected to a master server at 127.30.15.126:37123
I20260812 06:24:05.027683 12502 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:05.027824 12503 heartbeater.cc:347] Connected to a master server at 127.30.15.125:36849
I20260812 06:24:05.027850 12502 heartbeater.cc:511] Master 127.30.15.126:37123 requested a full tablet report, sending...
I20260812 06:24:05.027897 12503 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:05.027976 12503 heartbeater.cc:511] Master 127.30.15.125:36849 requested a full tablet report, sending...
I20260812 06:24:05.028311 10397 ts_manager.cc:194] Re-registered known tserver with Master: 6f72d3405a524e20b496d9750b728db1 (127.30.15.66:34441)
I20260812 06:24:05.028352 11565 ts_manager.cc:194] Registered new tserver with Master: 6f72d3405a524e20b496d9750b728db1 (127.30.15.66:34441)
I20260812 06:24:05.028892 10397 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:49903
I20260812 06:24:05.051625 12498 heartbeater.cc:347] Connected to a master server at 127.30.15.124:36653
I20260812 06:24:05.051684 12498 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:05.051760 12498 heartbeater.cc:511] Master 127.30.15.124:36653 requested a full tablet report, sending...
I20260812 06:24:05.052009 11928 ts_manager.cc:194] Registered new tserver with Master: 6f72d3405a524e20b496d9750b728db1 (127.30.15.66:34441)
I20260812 06:24:05.057288 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:41593
--local_ip_for_outbound_sockets=127.30.15.67
--tserver_master_addrs=127.30.15.126:37123
--webserver_port=32967
--webserver_interface=127.30.15.67
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab
--principal=oryx/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.15.126:37123,127.30.15.125:36849
--tserver_master_addrs=127.30.15.126:37123,127.30.15.125:36849,127.30.15.124:36653 with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:24:05.097986 11484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.094790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36653 (local address 127.0.0.1:41344)
0812 06:24:05.094860 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:05.094873 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:05.094932 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:05.095092 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:05.095092 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:05.095094 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:05.095144 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.095145 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.096207 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.096208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.096931 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.096933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.097754 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.097755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.097821 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.097825 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:24:05.097875 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:24:05.097915 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 06:24:05.097987 12013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.094849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41344 (local address 127.30.15.124:36653)
0812 06:24:05.094917 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.094919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.094930 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:24:05.094985 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.094987 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.095013 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.095081 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:05.095319 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.096103 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.097030 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.097674 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.097746 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.097821 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.097881 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.097916 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:24:05.098300 11944 raft_consensus.cc:1203] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 06:24:05.098522 11988 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b50c6b548aa4ff5b3a6e46f491d44bd. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:05.098647 11988 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: This master's current role is: LEARNER
W20260812 06:24:05.138164 12514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:05.138329 12514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:05.138350 12514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:05.139583 12514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:05.139629 12514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:05.139655 12514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:24:05.141207 12514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab
--principal=oryx/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:41593
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=32967
--tserver_master_addrs=127.30.15.126:37123,127.30.15.125:36849,127.30.15.124:36653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:05.141417 12514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:05.141635 12514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:05.146407 12524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:05.146476 12535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:05.146665 12526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:05.146723 12514 server_base.cc:1034] running on GCE node
I20260812 06:24:05.146922 12514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:05.147147 12514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:05.148285 12514 hybrid_clock.cc:648] HybridClock initialized: now 1786515845148272 us; error 29 us; skew 500 ppm
Aug 12 06:24:05 dist-test-slave-gjrz krb5kdc[10314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515845, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:05.150552 12514 init.cc:377] Logged in from keytab as oryx/127.30.15.67@KRBTEST.COM (short username oryx)
I20260812 06:24:05.150955 12514 webserver.cc:460] Webserver started at http://127.30.15.67:32967/ using document root <none> and password file <none>
I20260812 06:24:05.151146 12514 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:05.151197 12514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:05.152405 12514 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:05.152889 12552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:05.153059 12514 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:05.153126 12514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "77eb826004a14efda7db38220b63e405"
format_stamp: "Formatted at 2026-08-12 06:24:04 on dist-test-slave-gjrz"
server_key: "4f85e8cf8009d04b7358ffb86c52727a"
server_key_iv: "011b2d1137e09d4e61695dc7ceb92429"
server_key_version: "encryptionkey@0"
I20260812 06:24:05.153409 12514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:05.171865 12514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:05.173632 12514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:05.173758 12514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:05.173959 12514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:05.174234 12514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:05.174266 12514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:05.174292 12514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:05.174310 12514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:05.179813 12514 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:41593
I20260812 06:24:05.179875 12759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:41593 every 8 connection(s)
I20260812 06:24:05.180169 12514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:24:05.181994 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 12514
Aug 12 06:24:05 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515845, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.124@KRBTEST.COM
Aug 12 06:24:05 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515845, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
Aug 12 06:24:05 dist-test-slave-gjrz krb5kdc[10314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515845, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.125@KRBTEST.COM
I20260812 06:24:05.192687 12774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.180822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36653 (local address 127.30.15.67:56205)
0812 06:24:05.181289 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:05.181298 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:05.182133 (+ 835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:05.182404 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:05.182408 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:05.182910 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:05.183182 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.183189 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.184148 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.184149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.185504 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.185507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.186190 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.186191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.186256 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.186776 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:05.186785 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:05.189365 (+ 2580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:05.191066 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:05.191073 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:05.191075 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:05.191377 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:05.191606 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:05.191607 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:05.191607 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:05.191733 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:05.192033 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:05.192040 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:05.192189 (+ 149us) client_negotiation.cc:769] Sending connection context
0812 06:24:05.192294 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 06:24:05.192452 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"mutex_wait_us":101,"spinlock_wait_cycles":6400,"thread_start_us":142,"threads_started":1}
I20260812 06:24:05.194381 12013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.180809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:56205 (local address 127.30.15.124:36653)
0812 06:24:05.180853 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.180856 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.181365 (+ 509us) server_negotiation.cc:407] Connection header received
0812 06:24:05.182221 (+ 856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.182223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.182234 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.182262 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:05.183308 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.184029 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.185780 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.186086 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.186138 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.189438 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:05.189440 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:05.189440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:05.189447 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:05.190941 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.191453 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.191454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.191454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.191538 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.191805 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.191806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.191807 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.191945 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:05.192003 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.194227 (+ 2224us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.194296 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:24:05.194693 12760 heartbeater.cc:347] Connected to a master server at 127.30.15.124:36653
I20260812 06:24:05.194785 12760 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:05.194972 12760 heartbeater.cc:511] Master 127.30.15.124:36653 requested a full tablet report, sending...
I20260812 06:24:05.195182 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.180795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:48673 (local address 127.30.15.126:37123)
0812 06:24:05.180922 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.180924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.181158 (+ 234us) server_negotiation.cc:407] Connection header received
0812 06:24:05.182180 (+ 1022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.182182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.182196 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.182226 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:05.183309 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.184084 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.185598 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.185894 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.185945 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.191135 (+ 5190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:05.191137 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:05.191137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:05.191143 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:05.193971 (+ 2828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.194327 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.194328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.194328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.194381 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.194574 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.194575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.194575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.194694 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:05.194749 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.195024 (+ 275us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.195096 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260812 06:24:05.195429 11667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.181240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:44149 (local address 127.30.15.125:36849)
0812 06:24:05.181287 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.181289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.181386 (+ 97us) server_negotiation.cc:407] Connection header received
0812 06:24:05.182195 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.182197 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.182211 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.182243 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:05.183317 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.184080 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.185606 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.185905 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.185941 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.192965 (+ 7024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:05.192966 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:05.192966 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:05.192973 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:05.194330 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.194653 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.194654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.194655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.194704 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.194897 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.194897 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.194898 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.195030 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:05.195074 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.195293 (+ 219us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.195366 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:24:05.195430 11928 ts_manager.cc:194] Registered new tserver with Master: 77eb826004a14efda7db38220b63e405 (127.30.15.67:41593)
I20260812 06:24:05.195714 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.181162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:36849 (local address 127.30.15.67:44149)
0812 06:24:05.181288 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:05.181298 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:05.182069 (+ 771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:05.182404 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:05.182408 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:05.182917 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:05.183182 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.183188 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.184169 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.184170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.185503 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.185506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.186024 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.186025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.186168 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.186820 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:05.186825 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:05.192876 (+ 6051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:05.194401 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:05.194402 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:05.194402 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:05.194579 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:05.194773 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:05.194774 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:05.194774 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:05.194827 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:05.195121 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:05.195121 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:05.195158 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 06:24:05.195502 (+ 344us) client_negotiation.cc:240] Negotiation successful
0812 06:24:05.195603 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":144,"thread_start_us":61,"threads_started":1}
I20260812 06:24:05.196033 12765 heartbeater.cc:347] Connected to a master server at 127.30.15.125:36849
I20260812 06:24:05.196072 12765 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:05.196131 12765 heartbeater.cc:511] Master 127.30.15.125:36849 requested a full tablet report, sending...
I20260812 06:24:05.196386 11565 ts_manager.cc:194] Registered new tserver with Master: 77eb826004a14efda7db38220b63e405 (127.30.15.67:41593)
I20260812 06:24:05.196646 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.180822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.67:48673)
0812 06:24:05.181046 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:05.181079 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:05.182059 (+ 980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:05.182404 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:05.182408 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:05.182910 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:05.183182 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.183188 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.184169 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.184170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.185509 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.185511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.186005 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.186006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.186168 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.186914 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:05.186918 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:05.191056 (+ 4138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:05.194055 (+ 2999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:05.194056 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:05.194056 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:05.194253 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:05.194442 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:05.194443 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:05.194443 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:05.194494 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:05.194774 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:05.194774 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:05.194813 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 06:24:05.194873 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:24:05.194959 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":136,"thread_start_us":140,"threads_started":1}
I20260812 06:24:05.196888 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.183642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45976 (local address 127.30.15.125:36849)
0812 06:24:05.183857 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.183858 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.185203 (+ 1345us) server_negotiation.cc:407] Connection header received
0812 06:24:05.185226 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.185227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.185237 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.185284 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:05.187649 (+ 2365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.188119 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.189154 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.189436 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.189474 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.191088 (+ 1614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:05.191090 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:05.191090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:05.191097 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:05.192718 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.196036 (+ 3318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.196037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.196037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.196103 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.196308 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.196309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.196309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.196431 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:05.196501 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.196713 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.196791 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":56,"threads_started":1}
I20260812 06:24:05.196940 12763 heartbeater.cc:347] Connected to a master server at 127.30.15.126:37123
I20260812 06:24:05.196978 12763 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:05.197031 12763 heartbeater.cc:511] Master 127.30.15.126:37123 requested a full tablet report, sending...
I20260812 06:24:05.197021 12790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.186512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41356 (local address 127.30.15.124:36653)
0812 06:24:05.188545 (+ 2033us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.188547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.188554 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:24:05.188573 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.188574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.188585 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.188651 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:05.189377 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.190162 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.191166 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.191470 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.191534 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.192735 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:05.192736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:05.192736 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:05.192743 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:05.194197 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.195971 (+ 1774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.195972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.195973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.196047 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.196251 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.196252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.196252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.196371 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:05.196460 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.196807 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.196888 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2013,"thread_start_us":63,"threads_started":1}
I20260812 06:24:05.197232 10397 ts_manager.cc:194] Re-registered known tserver with Master: 77eb826004a14efda7db38220b63e405 (127.30.15.67:41593)
I20260812 06:24:05.197676 10397 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:48673
I20260812 06:24:05.198997 12782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.183139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54250 (local address 127.30.15.126:37123)
0812 06:24:05.184054 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.184056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.184063 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:24:05.184083 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.184084 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.184095 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.184307 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:05.185329 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.186004 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.188198 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.188413 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.188469 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.195732 (+ 7263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:05.195734 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:05.195734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:05.195741 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:05.198045 (+ 2304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.198382 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.198383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.198383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.198443 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.198583 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.198584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.198584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.198699 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:05.198768 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.198849 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.198910 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":884,"thread_start_us":59,"threads_started":1}
I20260812 06:24:05.200423 10397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54250:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:24:05.202075 10397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:24:05.202754 11490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: NON_VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: true } } }
I20260812 06:24:05.202841 11490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:05.204125 12794 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd: attempting to promote NON_VOTER f9a47aacfa234b9b850ae755b87ce90d to VOTER
I20260812 06:24:05.204254 12794 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } }
I20260812 06:24:05.204690 11597 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 FOLLOWER]: Refusing update from remote peer 1b50c6b548aa4ff5b3a6e46f491d44bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 06:24:05.204692 11944 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 LEARNER]: Refusing update from remote peer 1b50c6b548aa4ff5b3a6e46f491d44bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260812 06:24:05.204870 11490 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 06:24:05.205185 11490 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 06:24:05.205466 12796 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, f9a47aacfa234b9b850ae755b87ce90d (127.30.15.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } } }
I20260812 06:24:05.205866 11597 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, f9a47aacfa234b9b850ae755b87ce90d (127.30.15.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } } }
I20260812 06:24:05.206022 11944 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, f9a47aacfa234b9b850ae755b87ce90d (127.30.15.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } } }
I20260812 06:24:05.206410 12796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } } }
I20260812 06:24:05.206478 12796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:05.206449 11490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } } }
I20260812 06:24:05.206543 11490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:05.206550 12796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } } }
I20260812 06:24:05.206707 12796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:05.207019 11988 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } } }
I20260812 06:24:05.207105 11988 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:24:05.208601 12813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } } }
I20260812 06:24:05.208690 12813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:24:05.211462 11484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.207600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:34441 (local address 127.0.0.1:34164)
0812 06:24:05.207648 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:05.207657 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:05.207693 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:05.208126 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:05.208127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:05.208129 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:05.208165 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.208166 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.209363 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.209364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.210370 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.210372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.211200 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.211201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.211302 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.211306 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:24:05.211366 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:24:05.211401 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":1}
I20260812 06:24:05.211645 12819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.207831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34164 (local address 127.30.15.66:34441)
0812 06:24:05.207978 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.207982 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.207991 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:24:05.208029 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.208030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.208043 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.208112 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:05.208241 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.209303 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.210462 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.211112 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.211180 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.211257 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.211382 (+ 125us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.211423 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":79,"threads_started":1}
I20260812 06:24:05.211798 12815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.207623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:41593 (local address 127.0.0.1:38808)
0812 06:24:05.207748 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:05.207759 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:05.207808 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:05.208295 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:05.208296 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:05.208298 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:05.208338 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.208340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.209630 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.209631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.210660 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.210663 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.211593 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.211594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.211655 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.211659 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:24:05.211701 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 06:24:05.211735 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":80,"threads_started":1}
I20260812 06:24:05.212136 12817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.207602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:39219 (local address 127.0.0.1:58098)
0812 06:24:05.208771 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:05.208782 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:05.208830 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:05.209138 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:05.209139 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:05.209141 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:05.209177 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.209178 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.210128 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.210129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.210909 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.210912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.211923 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.211924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.211971 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.211974 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:24:05.212020 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 06:24:05.212061 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1153,"mutex_wait_us":133,"thread_start_us":72,"threads_started":1}
I20260812 06:24:05.212416 12818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.207724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58098 (local address 127.30.15.65:39219)
0812 06:24:05.208948 (+ 1224us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.208952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.208962 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:24:05.209001 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.209003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.209030 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.209101 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:05.209244 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.210056 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.210998 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.211751 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.211817 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.211890 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.212294 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.212336 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1182,"thread_start_us":96,"threads_started":1}
I20260812 06:24:05.212494 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.207969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38808 (local address 127.30.15.67:41593)
0812 06:24:05.208104 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.208108 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.208118 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:24:05.208150 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.208152 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.208167 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.208238 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:05.208410 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.209548 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.210739 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.211434 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.211491 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.211557 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.212385 (+ 828us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.212424 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260812 06:24:05.212431 12378 tablet_service.cc:1467] Processing CreateTablet for tablet e3fb6e795777415895e54ffb7332464e (DEFAULT_TABLE table=test-table [id=f216eaf33e0f407da4329028c39ee9a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:05.212834 12378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3fb6e795777415895e54ffb7332464e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:05.213013 12640 tablet_service.cc:1467] Processing CreateTablet for tablet e3fb6e795777415895e54ffb7332464e (DEFAULT_TABLE table=test-table [id=f216eaf33e0f407da4329028c39ee9a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:05.213093 12135 tablet_service.cc:1467] Processing CreateTablet for tablet e3fb6e795777415895e54ffb7332464e (DEFAULT_TABLE table=test-table [id=f216eaf33e0f407da4329028c39ee9a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:05.213325 12640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3fb6e795777415895e54ffb7332464e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:05.213439 12135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3fb6e795777415895e54ffb7332464e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:05.215957 12825 tablet_bootstrap.cc:492] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405: Bootstrap starting.
I20260812 06:24:05.216306 12826 tablet_bootstrap.cc:492] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1: Bootstrap starting.
I20260812 06:24:05.216718 12825 tablet_bootstrap.cc:654] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:05.216919 12826 tablet_bootstrap.cc:654] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:05.217043 12829 tablet_bootstrap.cc:492] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece: Bootstrap starting.
I20260812 06:24:05.217074 12825 log.cc:824] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:05.217249 12826 log.cc:824] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:05.217748 12829 tablet_bootstrap.cc:654] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:05.217849 12825 tablet_bootstrap.cc:492] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405: No bootstrap required, opened a new log
I20260812 06:24:05.217916 12825 ts_tablet_manager.cc:1397] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:24:05.217998 12826 tablet_bootstrap.cc:492] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1: No bootstrap required, opened a new log
I20260812 06:24:05.218080 12826 ts_tablet_manager.cc:1397] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:24:05.218073 12829 log.cc:824] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:05.218822 12829 tablet_bootstrap.cc:492] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece: No bootstrap required, opened a new log
I20260812 06:24:05.218894 12829 ts_tablet_manager.cc:1397] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:24:05.219920 12825 raft_consensus.cc:348] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:05.220080 12825 raft_consensus.cc:374] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:05.220120 12825 raft_consensus.cc:729] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77eb826004a14efda7db38220b63e405, State: Initialized, Role: FOLLOWER
I20260812 06:24:05.220227 12825 consensus_queue.cc:260] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:05.220463 12825 ts_tablet_manager.cc:1428] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:24:05.220583 12763 heartbeater.cc:503] Master 127.30.15.126:37123 was elected leader, sending a full tablet report...
I20260812 06:24:05.220496 12826 raft_consensus.cc:348] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:05.221513 12826 raft_consensus.cc:374] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:05.221444 12829 raft_consensus.cc:348] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:05.221561 12826 raft_consensus.cc:729] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f72d3405a524e20b496d9750b728db1, State: Initialized, Role: FOLLOWER
I20260812 06:24:05.221596 12829 raft_consensus.cc:374] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:05.221632 12829 raft_consensus.cc:729] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee1f7a3ad5834111bf4c2bf180750ece, State: Initialized, Role: FOLLOWER
I20260812 06:24:05.221684 12826 consensus_queue.cc:260] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:05.221730 12829 consensus_queue.cc:260] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:05.222148 12502 heartbeater.cc:503] Master 127.30.15.126:37123 was elected leader, sending a full tablet report...
I20260812 06:24:05.222252 12252 heartbeater.cc:503] Master 127.30.15.126:37123 was elected leader, sending a full tablet report...
I20260812 06:24:05.222419 12829 ts_tablet_manager.cc:1428] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:24:05.222939 12826 ts_tablet_manager.cc:1428] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
W20260812 06:24:05.266713 12506 tablet.cc:2369] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:24:05.368492 12254 tablet.cc:2369] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:24:05.430841 12768 tablet.cc:2369] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:24:05.535605 12841 raft_consensus.cc:482] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:24:05.535722 12841 raft_consensus.cc:504] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:05.536101 12841 leader_election.cc:288] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f72d3405a524e20b496d9750b728db1 (127.30.15.66:34441), 77eb826004a14efda7db38220b63e405 (127.30.15.67:41593)
I20260812 06:24:05.538789 12819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.536333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:38275 (local address 127.30.15.66:34441)
0812 06:24:05.536382 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.536385 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.536487 (+ 102us) server_negotiation.cc:407] Connection header received
0812 06:24:05.536557 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.536558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.536569 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.536613 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:05.536740 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.537215 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.538150 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.538500 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.538571 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.538580 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.538689 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.538722 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:24:05.538826 12821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.536374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:36299 (local address 127.30.15.67:41593)
0812 06:24:05.536423 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.536424 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.536511 (+ 87us) server_negotiation.cc:407] Connection header received
0812 06:24:05.536584 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.536585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.536593 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.536636 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:05.536755 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.537224 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.538158 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.538519 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.538580 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.538587 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.538723 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.538760 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:24:05.538837 12845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.536269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:41593 (local address 127.30.15.65:36299)
0812 06:24:05.536436 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:05.536446 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:05.536520 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:05.536643 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:05.536644 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:05.536646 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:05.536696 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.536698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.537296 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.537297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.538074 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.538076 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.538589 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.538590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.538664 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.538668 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:24:05.538712 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:24:05.538751 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":77,"thread_start_us":35,"threads_started":1}
I20260812 06:24:05.538843 12842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.536269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:34441 (local address 127.30.15.65:38275)
0812 06:24:05.536416 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:05.536426 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:05.536486 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:05.536628 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:05.536629 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:05.536631 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:05.536686 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.536688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.537290 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.537291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.538071 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:05.538073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.538577 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.538578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:05.538633 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.538636 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:24:05.538679 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:24:05.538720 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":2,"thread_start_us":58,"threads_started":1}
I20260812 06:24:05.539175 12677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3fb6e795777415895e54ffb7332464e" candidate_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77eb826004a14efda7db38220b63e405" is_pre_election: true
I20260812 06:24:05.539219 12417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3fb6e795777415895e54ffb7332464e" candidate_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f72d3405a524e20b496d9750b728db1" is_pre_election: true
I20260812 06:24:05.539347 12677 raft_consensus.cc:2454] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee1f7a3ad5834111bf4c2bf180750ece in term 0.
I20260812 06:24:05.539381 12417 raft_consensus.cc:2454] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee1f7a3ad5834111bf4c2bf180750ece in term 0.
I20260812 06:24:05.539574 12047 leader_election.cc:302] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77eb826004a14efda7db38220b63e405, ee1f7a3ad5834111bf4c2bf180750ece; no voters:
I20260812 06:24:05.539696 12841 raft_consensus.cc:2781] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:24:05.539752 12841 raft_consensus.cc:482] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:24:05.539768 12841 raft_consensus.cc:3037] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:05.540444 12841 raft_consensus.cc:504] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:05.540555 12841 leader_election.cc:288] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [CANDIDATE]: Term 1 election: Requested vote from peers 6f72d3405a524e20b496d9750b728db1 (127.30.15.66:34441), 77eb826004a14efda7db38220b63e405 (127.30.15.67:41593)
I20260812 06:24:05.540705 12417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3fb6e795777415895e54ffb7332464e" candidate_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f72d3405a524e20b496d9750b728db1"
I20260812 06:24:05.540709 12677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3fb6e795777415895e54ffb7332464e" candidate_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77eb826004a14efda7db38220b63e405"
I20260812 06:24:05.540771 12417 raft_consensus.cc:3037] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:05.540781 12677 raft_consensus.cc:3037] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:05.541455 12417 raft_consensus.cc:2454] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee1f7a3ad5834111bf4c2bf180750ece in term 1.
I20260812 06:24:05.541502 12677 raft_consensus.cc:2454] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee1f7a3ad5834111bf4c2bf180750ece in term 1.
I20260812 06:24:05.541630 12046 leader_election.cc:302] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f72d3405a524e20b496d9750b728db1, ee1f7a3ad5834111bf4c2bf180750ece; no voters:
I20260812 06:24:05.541738 12841 raft_consensus.cc:2781] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:05.541851 12841 raft_consensus.cc:686] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 1 LEADER]: Becoming Leader. State: Replica: ee1f7a3ad5834111bf4c2bf180750ece, State: Running, Role: LEADER
I20260812 06:24:05.541985 12841 consensus_queue.cc:237] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:05.542744 10396 catalog_manager.cc:5495] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece reported cstate change: term changed from 0 to 1, leader changed from <none> to ee1f7a3ad5834111bf4c2bf180750ece (127.30.15.65). New cstate: current_term: 1 leader_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } health_report { overall_health: UNKNOWN } } }
I20260812 06:24:05.561651 12818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.559657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58104 (local address 127.30.15.65:39219)
0812 06:24:05.559706 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.559708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.559715 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:24:05.559744 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.559745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.559759 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.559821 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:24:05.559923 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.560375 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.561062 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.561245 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.561296 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.561399 (+ 103us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:24:05.561492 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:24:05.561547 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.561587 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.561604 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:24:05.563369 12677 raft_consensus.cc:1261] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405 [term 1 FOLLOWER]: Refusing update from remote peer ee1f7a3ad5834111bf4c2bf180750ece: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:05.563370 12417 raft_consensus.cc:1261] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1 [term 1 FOLLOWER]: Refusing update from remote peer ee1f7a3ad5834111bf4c2bf180750ece: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:05.563700 12841 consensus_queue.cc:1035] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:05.563817 12846 consensus_queue.cc:1035] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:05.566038 12851 mvcc.cc:205] Tried to move back new op lower bound from 7317568903424933888 to 7317568903340482560. Current Snapshot: MvccSnapshot[applied={T|T < 7317568903424933888}]
I20260812 06:24:05.566104 12853 mvcc.cc:205] Tried to move back new op lower bound from 7317568903424933888 to 7317568903340482560. Current Snapshot: MvccSnapshot[applied={T|T < 7317568903424933888}]
I20260812 06:24:05.569481 10396 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:05.569576 10396 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54250:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:05.570768 10396 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1b50c6b548aa4ff5b3a6e46f491d44bd: Sending DeleteTablet for 3 replicas of tablet e3fb6e795777415895e54ffb7332464e
I20260812 06:24:05.571223 12135 tablet_service.cc:1514] Processing DeleteTablet for tablet e3fb6e795777415895e54ffb7332464e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:05 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:58098
I20260812 06:24:05.571305 12378 tablet_service.cc:1514] Processing DeleteTablet for tablet e3fb6e795777415895e54ffb7332464e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:05 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:34164
I20260812 06:24:05.571483 12864 tablet_replica.cc:330] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece: stopping tablet replica
I20260812 06:24:05.571497 12640 tablet_service.cc:1514] Processing DeleteTablet for tablet e3fb6e795777415895e54ffb7332464e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:05 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:38808
I20260812 06:24:05.571587 12864 raft_consensus.cc:2229] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:24:05.571692 12864 raft_consensus.cc:2258] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:05.572142 12864 ts_tablet_manager.cc:1905] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:05.572533 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 10341
I20260812 06:24:05.578325 12864 ts_tablet_manager.cc:1918] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:24:05.578383 12864 log.cc:1196] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-0/wal/wals/e3fb6e795777415895e54ffb7332464e
I20260812 06:24:05.578608 12864 ts_tablet_manager.cc:1939] T e3fb6e795777415895e54ffb7332464e P ee1f7a3ad5834111bf4c2bf180750ece: Deleting consensus metadata
I20260812 06:24:05.587425 12868 tablet_replica.cc:330] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405: stopping tablet replica
I20260812 06:24:05.587558 12868 raft_consensus.cc:2229] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:05.587669 12868 raft_consensus.cc:2258] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:05.588127 12866 tablet_replica.cc:330] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1: stopping tablet replica
I20260812 06:24:05.588246 12866 raft_consensus.cc:2229] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:05.588327 12868 ts_tablet_manager.cc:1905] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:05.588361 12866 raft_consensus.cc:2258] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:05.588814 12866 ts_tablet_manager.cc:1905] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:05.590014 12868 ts_tablet_manager.cc:1918] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:24:05.590160 12868 log.cc:1196] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/e3fb6e795777415895e54ffb7332464e
W20260812 06:24:05.590155 12046 connection.cc:535] server connection from 127.0.0.1:58098 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:24:05.590476 12866 ts_tablet_manager.cc:1918] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:24:05.590559 12866 log.cc:1196] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/e3fb6e795777415895e54ffb7332464e
I20260812 06:24:05.590639 12868 ts_tablet_manager.cc:1939] T e3fb6e795777415895e54ffb7332464e P 77eb826004a14efda7db38220b63e405: Deleting consensus metadata
I20260812 06:24:05.590812 12866 ts_tablet_manager.cc:1939] T e3fb6e795777415895e54ffb7332464e P 6f72d3405a524e20b496d9750b728db1: Deleting consensus metadata
W20260812 06:24:05.591107 12553 connection.cc:441] server connection from 127.0.0.1:38808 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38808 (request call id 1) could send its response
W20260812 06:24:05.591192 12302 connection.cc:441] server connection from 127.0.0.1:34164 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34164 (request call id 1) could send its response
I20260812 06:24:05.599218 12786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.592557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45990 (local address 127.30.15.125:36849)
0812 06:24:05.592603 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.592605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.592614 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:24:05.592638 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.592639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.592651 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.592713 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:05.593393 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.593916 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.594773 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.595102 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.595166 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.596536 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:05.596537 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:05.596537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:05.596545 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:05.597966 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.598347 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.598348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.598348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.598423 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.598653 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.598654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.598654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.598786 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:05.598859 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.599046 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.599127 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:24:05.599886 12790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:05.592651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41370 (local address 127.30.15.124:36653)
0812 06:24:05.592716 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:05.592718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:05.592821 (+ 103us) server_negotiation.cc:407] Connection header received
0812 06:24:05.592876 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:05.592876 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:05.592888 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:05.592934 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:05.593495 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.594254 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.595061 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:05.595359 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:05.595423 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:05.597133 (+ 1710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:05.597135 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:05.597135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:05.597143 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:05.598672 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.598994 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.598995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.598996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.599059 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:05.599325 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:05.599326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:05.599327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:05.599469 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:05.599560 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:05.599746 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 06:24:05.599825 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 06:24:06.567618 12883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:06.567306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.67:35999)
0812 06:24:06.567464 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:06.567555 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
W20260812 06:24:06.567830 12763 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:37123 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
I20260812 06:24:06.568183 12886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:06.567962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.66:34543)
0812 06:24:06.568065 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:06.568139 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":55,"threads_started":1}
I20260812 06:24:06.568264 12885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:06.567673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.65:47169)
0812 06:24:06.568130 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:06.568217 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":59,"threads_started":1}
W20260812 06:24:06.568459 12252 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:37123 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
W20260812 06:24:06.568590 12502 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:37123 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
I20260812 06:24:07.070935 12887 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1b50c6b548aa4ff5b3a6e46f491d44bd)
I20260812 06:24:07.071066 12889 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1b50c6b548aa4ff5b3a6e46f491d44bd)
I20260812 06:24:07.071177 12887 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } }
I20260812 06:24:07.071242 12889 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } }
I20260812 06:24:07.071506 12887 leader_election.cc:288] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123), f9a47aacfa234b9b850ae755b87ce90d (127.30.15.124:36653)
I20260812 06:24:07.071851 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.071634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54760)
0812 06:24:07.071762 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.071809 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":55,"threads_started":1}
I20260812 06:24:07.071926 12889 leader_election.cc:288] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123), 1a72f31e5bc8404f9683326f3d2fb9dc (127.30.15.125:36849)
I20260812 06:24:07.072006 12890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.071596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54756)
0812 06:24:07.071888 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.071937 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":46,"threads_started":1}
W20260812 06:24:07.072134 11898 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
W20260812 06:24:07.072206 11534 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
I20260812 06:24:07.072623 12890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.072536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54764)
0812 06:24:07.072575 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.072597 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 06:24:07.072705 11534 leader_election.cc:334] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123): Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
I20260812 06:24:07.072806 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.072656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54774)
0812 06:24:07.072752 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.072778 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260812 06:24:07.072881 11898 leader_election.cc:334] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123): Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
I20260812 06:24:07.074714 12894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.071831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41382 (local address 127.30.15.124:36653)
0812 06:24:07.072074 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:07.072076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:07.072226 (+ 150us) server_negotiation.cc:407] Connection header received
0812 06:24:07.072251 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:07.072252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:07.072262 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:07.072317 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:07.072500 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:07.073144 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:07.074044 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:07.074394 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:07.074453 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:07.074465 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:07.074581 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 06:24:07.074622 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":43,"threads_started":1}
I20260812 06:24:07.074725 12896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.071910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36653 (local address 127.0.0.1:41382)
0812 06:24:07.072110 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.072118 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:07.072179 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:07.072368 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:07.072369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:07.072371 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:07.072427 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:07.072430 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:07.073222 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:07.073224 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:07.073964 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:07.073966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:07.074470 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:07.074471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:07.074523 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:07.074526 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:24:07.074570 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:24:07.074614 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":48,"threads_started":1}
I20260812 06:24:07.074730 12898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.071985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45998 (local address 127.30.15.125:36849)
0812 06:24:07.072170 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:07.072172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:07.072179 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:24:07.072201 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:07.072202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:07.072211 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:07.072445 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:07.072479 (+ 34us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:07.073150 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:07.074048 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:07.074406 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:07.074463 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:07.074473 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:07.074592 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 06:24:07.074633 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":38,"threads_started":1}
I20260812 06:24:07.074720 12892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.071826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:36849 (local address 127.0.0.1:45998)
0812 06:24:07.071987 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.071996 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:07.072070 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:07.072309 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:07.072310 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:07.072313 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:07.072380 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:07.072382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:07.073227 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:07.073228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:07.073963 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:07.073965 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:07.074474 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:07.074474 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:07.074534 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:07.074538 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:24:07.074581 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:24:07.074627 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":45,"threads_started":1}
I20260812 06:24:07.075078 11944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f9a47aacfa234b9b850ae755b87ce90d" is_pre_election: true
I20260812 06:24:07.075174 11944 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a72f31e5bc8404f9683326f3d2fb9dc in term 1.
I20260812 06:24:07.075196 11597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f9a47aacfa234b9b850ae755b87ce90d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" is_pre_election: true
I20260812 06:24:07.075326 11597 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9a47aacfa234b9b850ae755b87ce90d in term 1.
I20260812 06:24:07.075335 11539 leader_election.cc:302] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a72f31e5bc8404f9683326f3d2fb9dc, f9a47aacfa234b9b850ae755b87ce90d; no voters: 1b50c6b548aa4ff5b3a6e46f491d44bd
I20260812 06:24:07.075453 12887 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:24:07.075496 12887 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1b50c6b548aa4ff5b3a6e46f491d44bd)
I20260812 06:24:07.075516 12887 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:24:07.075518 11898 leader_election.cc:302] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a72f31e5bc8404f9683326f3d2fb9dc, f9a47aacfa234b9b850ae755b87ce90d; no voters: 1b50c6b548aa4ff5b3a6e46f491d44bd
I20260812 06:24:07.075605 12889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:24:07.075644 12889 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1b50c6b548aa4ff5b3a6e46f491d44bd)
I20260812 06:24:07.075663 12889 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:24:07.076205 12887 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } }
I20260812 06:24:07.076289 12889 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } }
I20260812 06:24:07.076321 12887 leader_election.cc:288] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [CANDIDATE]: Term 2 election: Requested vote from peers 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123), f9a47aacfa234b9b850ae755b87ce90d (127.30.15.124:36653)
I20260812 06:24:07.076404 12889 leader_election.cc:288] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [CANDIDATE]: Term 2 election: Requested vote from peers 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123), 1a72f31e5bc8404f9683326f3d2fb9dc (127.30.15.125:36849)
I20260812 06:24:07.076455 11944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f9a47aacfa234b9b850ae755b87ce90d"
I20260812 06:24:07.076539 11944 raft_consensus.cc:2379] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a72f31e5bc8404f9683326f3d2fb9dc in current term 2: Already voted for candidate f9a47aacfa234b9b850ae755b87ce90d in this term.
I20260812 06:24:07.076550 12896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.076409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54790)
0812 06:24:07.076500 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.076527 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 06:24:07.076608 11597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f9a47aacfa234b9b850ae755b87ce90d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc"
I20260812 06:24:07.076689 11597 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f9a47aacfa234b9b850ae755b87ce90d in current term 2: Already voted for candidate 1a72f31e5bc8404f9683326f3d2fb9dc in this term.
I20260812 06:24:07.076764 12892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.076482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54806)
0812 06:24:07.076515 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.076546 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260812 06:24:07.077013 12896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.076925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54814)
0812 06:24:07.076960 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.076989 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260812 06:24:07.077068 12892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.076976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:54828)
0812 06:24:07.077022 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.077047 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260812 06:24:07.077075 11534 leader_election.cc:334] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123): Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
I20260812 06:24:07.077131 11534 leader_election.cc:302] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a72f31e5bc8404f9683326f3d2fb9dc; no voters: 1b50c6b548aa4ff5b3a6e46f491d44bd, f9a47aacfa234b9b850ae755b87ce90d
W20260812 06:24:07.077136 11898 leader_election.cc:334] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123): Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
I20260812 06:24:07.077165 11898 leader_election.cc:302] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9a47aacfa234b9b850ae755b87ce90d; no voters: 1a72f31e5bc8404f9683326f3d2fb9dc, 1b50c6b548aa4ff5b3a6e46f491d44bd
I20260812 06:24:07.077198 12887 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 06:24:07.077229 12889 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 06:24:07.568377 12902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.568152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.67:41957)
0812 06:24:07.568272 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.568313 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":57,"threads_started":1}
I20260812 06:24:07.568964 12903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.568762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.65:60423)
0812 06:24:07.568886 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.568918 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":67,"threads_started":1}
I20260812 06:24:07.569169 12907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:07.568888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.66:38365)
0812 06:24:07.569089 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:07.569126 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":60,"threads_started":1}
I20260812 06:24:08.569191 12908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.568913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.67:33799)
0812 06:24:08.569087 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.569139 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":72,"threads_started":1}
I20260812 06:24:08.569778 12909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.569493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.65:55191)
0812 06:24:08.569684 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.569722 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":58,"threads_started":1}
I20260812 06:24:08.570312 12911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.569624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.66:44769)
0812 06:24:08.569979 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.570018 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":45,"threads_started":1}
I20260812 06:24:08.762130 12913 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:24:08.762219 12913 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } }
I20260812 06:24:08.762343 12913 leader_election.cc:288] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123), 1a72f31e5bc8404f9683326f3d2fb9dc (127.30.15.125:36849)
I20260812 06:24:08.762652 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.762452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:55014)
0812 06:24:08.762575 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.762612 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":49,"threads_started":1}
I20260812 06:24:08.762677 11597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f9a47aacfa234b9b850ae755b87ce90d" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" is_pre_election: true
I20260812 06:24:08.762789 11597 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9a47aacfa234b9b850ae755b87ce90d in term 2.
I20260812 06:24:08.763024 11898 leader_election.cc:302] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a72f31e5bc8404f9683326f3d2fb9dc, f9a47aacfa234b9b850ae755b87ce90d; no voters:
I20260812 06:24:08.763083 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.762963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:55022)
0812 06:24:08.762996 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.763022 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260812 06:24:08.763119 11898 leader_election.cc:334] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123): Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
I20260812 06:24:08.763144 12913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 06:24:08.763188 12913 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:24:08.763213 12913 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:24:08.763931 12913 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } }
I20260812 06:24:08.764055 12913 leader_election.cc:288] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [CANDIDATE]: Term 3 election: Requested vote from peers 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123), 1a72f31e5bc8404f9683326f3d2fb9dc (127.30.15.125:36849)
I20260812 06:24:08.764215 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.764127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:55032)
0812 06:24:08.764162 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.764189 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260812 06:24:08.764292 11597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f9a47aacfa234b9b850ae755b87ce90d" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc"
I20260812 06:24:08.764377 11597 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:24:08.764565 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.764439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:55036)
0812 06:24:08.764474 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.764544 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260812 06:24:08.765106 11898 leader_election.cc:334] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123): Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
I20260812 06:24:08.765319 11597 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9a47aacfa234b9b850ae755b87ce90d in term 3.
I20260812 06:24:08.765470 11898 leader_election.cc:302] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a72f31e5bc8404f9683326f3d2fb9dc, f9a47aacfa234b9b850ae755b87ce90d; no voters: 1b50c6b548aa4ff5b3a6e46f491d44bd
I20260812 06:24:08.765548 12913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:24:08.765641 12913 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [term 3 LEADER]: Becoming Leader. State: Replica: f9a47aacfa234b9b850ae755b87ce90d, State: Running, Role: LEADER
I20260812 06:24:08.765704 12913 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } }
I20260812 06:24:08.766113 12916 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9a47aacfa234b9b850ae755b87ce90d. Latest consensus state: current_term: 3 leader_uuid: "f9a47aacfa234b9b850ae755b87ce90d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } } }
I20260812 06:24:08.766206 12916 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:08.766515 12918 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:24:08.766911 12918 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:24:08.766976 12918 catalog_manager.cc:1259] Loaded cluster ID: f6cc4d2708c047ca83dc22b2c1e38414
I20260812 06:24:08.767007 12918 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:24:08.767230 12918 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:24:08.767356 12918 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: Loaded TSK: 0
I20260812 06:24:08.767535 12918 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:24:08.830041 11927 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:24:08.831809 11927 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:24:08.832779 11597 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [term 3 FOLLOWER]: Refusing update from remote peer f9a47aacfa234b9b850ae755b87ce90d: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260812 06:24:08.832816 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.832697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:55050)
0812 06:24:08.832746 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.832779 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:24:08.832994 12916 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 06:24:08.833137 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.833038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.0.0.1:55054)
0812 06:24:08.833084 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.833116 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 06:24:08.833220 11898 consensus_peers.cc:487] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d -> Peer 1b50c6b548aa4ff5b3a6e46f491d44bd (127.30.15.126:37123): Couldn't send request to peer 1b50c6b548aa4ff5b3a6e46f491d44bd. Status: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:24:08.833626 12920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9a47aacfa234b9b850ae755b87ce90d. Latest consensus state: current_term: 3 leader_uuid: "f9a47aacfa234b9b850ae755b87ce90d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } } }
I20260812 06:24:08.833716 12920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:24:08.834009 12919 mvcc.cc:205] Tried to move back new op lower bound from 7317568916817268736 to 7317568916545277952. Current Snapshot: MvccSnapshot[applied={T|T < 7317568916817268736}]
I20260812 06:24:08.834128 12913 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "f9a47aacfa234b9b850ae755b87ce90d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } } }
I20260812 06:24:08.834214 12913 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:08.834347 12920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "f9a47aacfa234b9b850ae755b87ce90d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "1b50c6b548aa4ff5b3a6e46f491d44bd" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37123 } } peers { permanent_uuid: "1a72f31e5bc8404f9683326f3d2fb9dc" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 36849 } attrs { promote: false } } peers { permanent_uuid: "f9a47aacfa234b9b850ae755b87ce90d" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36653 } attrs { promote: false } } }
I20260812 06:24:08.834467 12920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a72f31e5bc8404f9683326f3d2fb9dc [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:24:08.838757 12932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.835927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34168 (local address 127.30.15.66:34441)
0812 06:24:08.836046 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:08.836048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:08.836055 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:24:08.836082 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:08.836083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:08.836093 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:08.836148 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:08.836291 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:08.836903 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:08.837932 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:08.838450 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:08.838511 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:08.838525 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:08.838651 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 06:24:08.838690 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":69,"threads_started":1}
I20260812 06:24:08.838749 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.835809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:34441 (local address 127.0.0.1:34168)
0812 06:24:08.835894 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.835904 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:08.835956 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:08.836162 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:08.836163 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:08.836165 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:08.836217 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:08.836218 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:08.836977 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:08.836977 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:08.837724 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:08.837726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:08.838520 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:08.838521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:08.838591 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:08.838595 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:24:08.838639 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:24:08.838683 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":33}
I20260812 06:24:08.839048 12378 tablet_service.cc:1467] Processing CreateTablet for tablet 132c5a3b3a37459fb90fa26e5587e2ad (DEFAULT_TABLE table=test-table [id=34cf2c15b85e4a5388216ce23e2f5910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:08.839193 12378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 132c5a3b3a37459fb90fa26e5587e2ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:08.839995 12935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.836024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38820 (local address 127.30.15.67:41593)
0812 06:24:08.836151 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:08.836153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:08.836161 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:08.836324 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:08.836325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:08.836335 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:08.836399 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:08.837114 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:08.837841 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:08.839323 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:08.839701 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:08.839756 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:08.839766 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:08.839914 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 06:24:08.839945 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":66,"threads_started":1}
I20260812 06:24:08.840011 12927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.835855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:41593 (local address 127.0.0.1:38820)
0812 06:24:08.836100 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.836108 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:08.836145 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:08.836459 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:08.836460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:08.836462 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:08.836510 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:08.836511 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:08.838247 (+ 1736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:08.838248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:08.839222 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:08.839225 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:08.839779 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:08.839780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:08.839840 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:08.839844 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:24:08.839910 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 06:24:08.839948 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":69,"threads_started":1}
I20260812 06:24:08.840225 12640 tablet_service.cc:1467] Processing CreateTablet for tablet 132c5a3b3a37459fb90fa26e5587e2ad (DEFAULT_TABLE table=test-table [id=34cf2c15b85e4a5388216ce23e2f5910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:08.840344 12640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 132c5a3b3a37459fb90fa26e5587e2ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:08.840739 12936 tablet_bootstrap.cc:492] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1: Bootstrap starting.
I20260812 06:24:08.840767 12931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.835840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:39219 (local address 127.0.0.1:58114)
0812 06:24:08.835977 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.835986 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:08.836033 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:08.836387 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:08.836388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:08.836390 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:08.836426 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:08.836427 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:08.837087 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:08.837088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:08.838171 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:08.838174 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:08.838926 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:08.838927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:08.840619 (+ 1692us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:08.840624 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:24:08.840675 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 06:24:08.840708 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":79,"threads_started":1}
I20260812 06:24:08.841037 12933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.836036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58114 (local address 127.30.15.65:39219)
0812 06:24:08.836227 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:08.836229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:08.836237 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:08.836263 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:08.836263 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:08.836274 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:08.836340 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:08.836514 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:08.837008 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:08.838242 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:08.838818 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:08.838882 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:08.838894 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:08.840902 (+ 2008us) server_negotiation.cc:299] Negotiation successful
0812 06:24:08.840954 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":56,"threads_started":1}
I20260812 06:24:08.841125 12936 tablet_bootstrap.cc:654] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:08.841225 12135 tablet_service.cc:1467] Processing CreateTablet for tablet 132c5a3b3a37459fb90fa26e5587e2ad (DEFAULT_TABLE table=test-table [id=34cf2c15b85e4a5388216ce23e2f5910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:08.841336 12135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 132c5a3b3a37459fb90fa26e5587e2ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:08.841787 12941 tablet_bootstrap.cc:492] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405: Bootstrap starting.
I20260812 06:24:08.841838 12936 tablet_bootstrap.cc:492] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1: No bootstrap required, opened a new log
I20260812 06:24:08.841905 12936 ts_tablet_manager.cc:1397] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:08.842133 12936 raft_consensus.cc:348] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:08.842211 12941 tablet_bootstrap.cc:654] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:08.842217 12936 raft_consensus.cc:374] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:08.842238 12936 raft_consensus.cc:729] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f72d3405a524e20b496d9750b728db1, State: Initialized, Role: FOLLOWER
I20260812 06:24:08.842284 12936 consensus_queue.cc:260] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:08.842486 12936 ts_tablet_manager.cc:1428] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260812 06:24:08.842751 12945 tablet_bootstrap.cc:492] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece: Bootstrap starting.
I20260812 06:24:08.842836 12941 tablet_bootstrap.cc:492] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405: No bootstrap required, opened a new log
I20260812 06:24:08.842878 12941 ts_tablet_manager.cc:1397] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:08.843004 12941 raft_consensus.cc:348] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:08.843060 12941 raft_consensus.cc:374] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:08.843078 12941 raft_consensus.cc:729] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77eb826004a14efda7db38220b63e405, State: Initialized, Role: FOLLOWER
I20260812 06:24:08.842818 12911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.842639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.66:59443)
0812 06:24:08.842751 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.842791 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260812 06:24:08.843125 12941 consensus_queue.cc:260] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:08.843144 12945 tablet_bootstrap.cc:654] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:08.843330 12941 ts_tablet_manager.cc:1428] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:08.843438 12498 heartbeater.cc:503] Master 127.30.15.124:36653 was elected leader, sending a full tablet report...
I20260812 06:24:08.843607 12908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.843514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.67:58525)
0812 06:24:08.843555 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.843579 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 06:24:08.843632 12945 tablet_bootstrap.cc:492] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece: No bootstrap required, opened a new log
I20260812 06:24:08.843677 12945 ts_tablet_manager.cc:1397] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:08.843781 12945 raft_consensus.cc:348] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:08.843842 12945 raft_consensus.cc:374] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:08.843861 12945 raft_consensus.cc:729] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee1f7a3ad5834111bf4c2bf180750ece, State: Initialized, Role: FOLLOWER
I20260812 06:24:08.843912 12945 consensus_queue.cc:260] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:08.844087 12760 heartbeater.cc:503] Master 127.30.15.124:36653 was elected leader, sending a full tablet report...
I20260812 06:24:08.844084 12945 ts_tablet_manager.cc:1428] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:08.844462 12909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.844349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.65:59831)
0812 06:24:08.844397 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.844425 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 06:24:08.844677 12911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.844579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.66:39237)
0812 06:24:08.844618 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.844652 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260812 06:24:08.844884 12908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:08.844809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.67:45535)
0812 06:24:08.844841 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:08.844866 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260812 06:24:09.054407 12944 raft_consensus.cc:482] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:24:09.054498 12944 raft_consensus.cc:504] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:09.054838 12944 leader_election.cc:288] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee1f7a3ad5834111bf4c2bf180750ece (127.30.15.65:39219), 77eb826004a14efda7db38220b63e405 (127.30.15.67:41593)
I20260812 06:24:09.058584 12935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.055101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:50035 (local address 127.30.15.67:41593)
0812 06:24:09.055151 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:09.055152 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:09.055333 (+ 181us) server_negotiation.cc:407] Connection header received
0812 06:24:09.055396 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:09.055397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:09.055410 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:09.055455 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:09.055623 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:09.056313 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:09.057634 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:09.058206 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:09.058291 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:09.058303 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:09.058469 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 06:24:09.058515 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:24:09.058584 12933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.055091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:50835 (local address 127.30.15.65:39219)
0812 06:24:09.055138 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:09.055140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:09.055150 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:24:09.055209 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:09.055210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:09.055219 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:09.055296 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:09.055426 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:09.056147 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:09.057637 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:09.058226 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:09.058291 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:09.058303 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:09.058470 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 06:24:09.058512 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:24:09.058589 12911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.055015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:39219 (local address 127.30.15.66:50835)
0812 06:24:09.055073 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:09.055084 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:09.055142 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:09.055297 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:09.055299 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:09.055301 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:09.055363 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:09.055365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:09.056232 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:09.056249 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:09.057520 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:09.057522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:09.058308 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:09.058308 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:09.058382 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:09.058390 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 06:24:09.058462 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:24:09.058491 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":9}
I20260812 06:24:09.058605 12955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.055039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:41593 (local address 127.30.15.66:50035)
0812 06:24:09.055249 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:09.055277 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:09.055339 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:09.055465 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:09.055466 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:09.055467 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:09.055527 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:09.055529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:09.056363 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:09.056364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:09.057519 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:09.057522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:09.058306 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:09.058307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:09.058382 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:09.058388 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:24:09.058447 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:24:09.058491 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":8,"thread_start_us":131,"threads_started":1}
I20260812 06:24:09.058882 12169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "132c5a3b3a37459fb90fa26e5587e2ad" candidate_uuid: "6f72d3405a524e20b496d9750b728db1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" is_pre_election: true
I20260812 06:24:09.058986 12677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "132c5a3b3a37459fb90fa26e5587e2ad" candidate_uuid: "6f72d3405a524e20b496d9750b728db1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77eb826004a14efda7db38220b63e405" is_pre_election: true
I20260812 06:24:09.059046 12169 raft_consensus.cc:2454] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f72d3405a524e20b496d9750b728db1 in term 0.
I20260812 06:24:09.059080 12677 raft_consensus.cc:2454] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f72d3405a524e20b496d9750b728db1 in term 0.
I20260812 06:24:09.059226 12302 leader_election.cc:302] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f72d3405a524e20b496d9750b728db1, ee1f7a3ad5834111bf4c2bf180750ece; no voters:
I20260812 06:24:09.059399 12944 raft_consensus.cc:2781] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:24:09.059460 12944 raft_consensus.cc:482] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:24:09.059475 12944 raft_consensus.cc:3037] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:09.060200 12944 raft_consensus.cc:504] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:09.060389 12944 leader_election.cc:288] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [CANDIDATE]: Term 1 election: Requested vote from peers ee1f7a3ad5834111bf4c2bf180750ece (127.30.15.65:39219), 77eb826004a14efda7db38220b63e405 (127.30.15.67:41593)
I20260812 06:24:09.060506 12677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "132c5a3b3a37459fb90fa26e5587e2ad" candidate_uuid: "6f72d3405a524e20b496d9750b728db1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77eb826004a14efda7db38220b63e405"
I20260812 06:24:09.060500 12169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "132c5a3b3a37459fb90fa26e5587e2ad" candidate_uuid: "6f72d3405a524e20b496d9750b728db1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee1f7a3ad5834111bf4c2bf180750ece"
I20260812 06:24:09.060575 12677 raft_consensus.cc:3037] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:09.060576 12169 raft_consensus.cc:3037] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:09.061151 12677 raft_consensus.cc:2454] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f72d3405a524e20b496d9750b728db1 in term 1.
I20260812 06:24:09.061285 12169 raft_consensus.cc:2454] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f72d3405a524e20b496d9750b728db1 in term 1.
I20260812 06:24:09.061326 12300 leader_election.cc:302] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f72d3405a524e20b496d9750b728db1, 77eb826004a14efda7db38220b63e405; no voters:
I20260812 06:24:09.061431 12944 raft_consensus.cc:2781] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:09.061584 12944 raft_consensus.cc:686] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 1 LEADER]: Becoming Leader. State: Replica: 6f72d3405a524e20b496d9750b728db1, State: Running, Role: LEADER
I20260812 06:24:09.061698 12944 consensus_queue.cc:237] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } }
I20260812 06:24:09.061934 12955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.061780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.66:47955)
0812 06:24:09.061862 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:09.061907 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 06:24:09.062474 11926 catalog_manager.cc:5495] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f72d3405a524e20b496d9750b728db1 (127.30.15.66). New cstate: current_term: 1 leader_uuid: "6f72d3405a524e20b496d9750b728db1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f72d3405a524e20b496d9750b728db1" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 } health_report { overall_health: UNKNOWN } } }
I20260812 06:24:09.118908 12932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.116867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34182 (local address 127.30.15.66:34441)
0812 06:24:09.116921 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:09.116923 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:09.116931 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:09.116965 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:09.116966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:09.117005 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:09.117061 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:24:09.117162 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:09.117614 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:09.118286 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:09.118482 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:09.118535 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:09.118635 (+ 100us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:24:09.118734 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:24:09.118782 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:09.118798 (+ 16us) server_negotiation.cc:299] Negotiation successful
0812 06:24:09.118816 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:24:09.119969 12677 raft_consensus.cc:1261] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405 [term 1 FOLLOWER]: Refusing update from remote peer 6f72d3405a524e20b496d9750b728db1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:09.120116 12169 raft_consensus.cc:1261] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece [term 1 FOLLOWER]: Refusing update from remote peer 6f72d3405a524e20b496d9750b728db1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:09.120257 12944 consensus_queue.cc:1035] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77eb826004a14efda7db38220b63e405" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 41593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:09.120396 12957 consensus_queue.cc:1035] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee1f7a3ad5834111bf4c2bf180750ece" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 39219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:09.121099 12908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.120984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.67:59357)
0812 06:24:09.121038 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:09.121069 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 06:24:09.121263 12251 heartbeater.cc:503] Master 127.30.15.124:36653 was elected leader, sending a full tablet report...
I20260812 06:24:09.121666 12909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.121496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.65:56317)
0812 06:24:09.121602 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:09.121637 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260812 06:24:09.122272 12955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.122188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.66:42575)
0812 06:24:09.122216 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:09.122243 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260812 06:24:09.123292 12909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.123156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.65:32863)
0812 06:24:09.123207 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:09.123242 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 06:24:09.123564 12955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.123461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.66:50805)
0812 06:24:09.123504 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:09.123538 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 06:24:09.123529 12963 mvcc.cc:205] Tried to move back new op lower bound from 7317568917993594880 to 7317568917757198336. Current Snapshot: MvccSnapshot[applied={T|T < 7317568917993594880}]
I20260812 06:24:09.123736 12908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.123652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37123 (local address 127.30.15.67:52593)
0812 06:24:09.123690 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:09.123710 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:37123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 06:24:09.125155 11927 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:09.125247 11927 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:09.126420 11927 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f9a47aacfa234b9b850ae755b87ce90d: Sending DeleteTablet for 3 replicas of tablet 132c5a3b3a37459fb90fa26e5587e2ad
I20260812 06:24:09.126750 12378 tablet_service.cc:1514] Processing DeleteTablet for tablet 132c5a3b3a37459fb90fa26e5587e2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:09 UTC) from {username='oryx', principal='oryx/127.30.15.124@KRBTEST.COM'} at 127.0.0.1:34168
I20260812 06:24:09.126842 12135 tablet_service.cc:1514] Processing DeleteTablet for tablet 132c5a3b3a37459fb90fa26e5587e2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:09 UTC) from {username='oryx', principal='oryx/127.30.15.124@KRBTEST.COM'} at 127.0.0.1:58114
I20260812 06:24:09.126924 12978 tablet_replica.cc:330] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1: stopping tablet replica
I20260812 06:24:09.126969 12978 raft_consensus.cc:2229] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:24:09.127048 12978 raft_consensus.cc:2258] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:09.127192 12640 tablet_service.cc:1514] Processing DeleteTablet for tablet 132c5a3b3a37459fb90fa26e5587e2ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:09 UTC) from {username='oryx', principal='oryx/127.30.15.124@KRBTEST.COM'} at 127.0.0.1:38820
I20260812 06:24:09.127350 12978 ts_tablet_manager.cc:1905] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:09.127470 12982 tablet_replica.cc:330] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405: stopping tablet replica
I20260812 06:24:09.127478 12980 tablet_replica.cc:330] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece: stopping tablet replica
I20260812 06:24:09.127537 12980 raft_consensus.cc:2229] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:09.127579 12980 raft_consensus.cc:2258] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:09.127645 12982 raft_consensus.cc:2229] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:09.127730 12982 raft_consensus.cc:2258] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:09.127755 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 12015
I20260812 06:24:09.127846 12980 ts_tablet_manager.cc:1905] T 132c5a3b3a37459fb90fa26e5587e2ad P ee1f7a3ad5834111bf4c2bf180750ece: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:09.128090 12982 ts_tablet_manager.cc:1905] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:09.129895 12978 ts_tablet_manager.cc:1918] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:24:09.129959 12978 log.cc:1196] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/132c5a3b3a37459fb90fa26e5587e2ad
I20260812 06:24:09.129912 12982 ts_tablet_manager.cc:1918] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:24:09.130075 12982 log.cc:1196] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/132c5a3b3a37459fb90fa26e5587e2ad
I20260812 06:24:09.130211 12978 ts_tablet_manager.cc:1939] T 132c5a3b3a37459fb90fa26e5587e2ad P 6f72d3405a524e20b496d9750b728db1: Deleting consensus metadata
I20260812 06:24:09.130311 12982 ts_tablet_manager.cc:1939] T 132c5a3b3a37459fb90fa26e5587e2ad P 77eb826004a14efda7db38220b63e405: Deleting consensus metadata
I20260812 06:24:09.130519 11899 catalog_manager.cc:4841] TS 6f72d3405a524e20b496d9750b728db1 (127.30.15.66:34441): tablet 132c5a3b3a37459fb90fa26e5587e2ad (table test-table [id=34cf2c15b85e4a5388216ce23e2f5910]) successfully deleted
I20260812 06:24:09.130573 11901 catalog_manager.cc:4841] TS 77eb826004a14efda7db38220b63e405 (127.30.15.67:41593): tablet 132c5a3b3a37459fb90fa26e5587e2ad (table test-table [id=34cf2c15b85e4a5388216ce23e2f5910]) successfully deleted
I20260812 06:24:09.163780 12931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:09.163664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:39219 (local address 127.0.0.1:58126)
0812 06:24:09.163722 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:09.163744 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:39219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 06:24:09.163926 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 12268
W20260812 06:24:09.163944 11903 catalog_manager.cc:4584] TS ee1f7a3ad5834111bf4c2bf180750ece (127.30.15.65:39219): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 132c5a3b3a37459fb90fa26e5587e2ad: Network error: Client connection negotiation failed: client connection to 127.30.15.65:39219: connect: Connection refused (error 111)
I20260812 06:24:09.171852 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 12514
I20260812 06:24:09.181653 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 11307
I20260812 06:24:09.194897 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 11675
2026-08-12T06:24:09Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6969 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:24:09 dist-test-slave-gjrz krb5kdc[12986](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:24:09 dist-test-slave-gjrz krb5kdc[12986](info): set up 2 sockets
Aug 12 06:24:09 dist-test-slave-gjrz krb5kdc[12986](info): commencing operation
krb5kdc: starting...
W20260812 06:24:10.385799 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:24:10 dist-test-slave-gjrz krb5kdc[12986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:24:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:24:10Z Disabled control of system clock
WARNING: no policy specified for oryx/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.126.keytab.
Entry for principal oryx/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.126.keytab.
I20260812 06:24:10.497334 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:39035
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.126.keytab
--principal=oryx/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:39791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:39035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:10.577598 13016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:10.577786 13016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:10.577818 13016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:10.578933 13016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:24:10.578972 13016 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:24:10.578996 13016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:10.579013 13016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:10.579030 13016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:24:10.579051 13016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:24:10.580523 13016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:39035
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.126.keytab
--principal=oryx/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:39035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:10.580750 13016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:10.580967 13016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:10.585505 13024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:10.585520 13025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:10.585590 13029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:10.585593 13016 server_base.cc:1034] running on GCE node
I20260812 06:24:10.585922 13016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:10.586189 13016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:10.587308 13016 hybrid_clock.cc:648] HybridClock initialized: now 1786515850587290 us; error 33 us; skew 500 ppm
Aug 12 06:24:10 dist-test-slave-gjrz krb5kdc[12986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515850, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:10.592892 13016 init.cc:377] Logged in from keytab as oryx/127.30.15.126@KRBTEST.COM (short username oryx)
I20260812 06:24:10.593308 13016 webserver.cc:460] Webserver started at http://127.30.15.126:43903/ using document root <none> and password file <none>
I20260812 06:24:10.593505 13016 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:10.593552 13016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:10.593675 13016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:10.594660 13016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "8ee3defd9f5c425892fd862f94a0242e"
format_stamp: "Formatted at 2026-08-12 06:24:10 on dist-test-slave-gjrz"
server_key: "269e6e2c696921ca4617661d07d0c454"
server_key_iv: "2282968aeef34973358dcdc77bfb548b"
server_key_version: "encryptionkey@0"
I20260812 06:24:10.594986 13016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "8ee3defd9f5c425892fd862f94a0242e"
format_stamp: "Formatted at 2026-08-12 06:24:10 on dist-test-slave-gjrz"
server_key: "269e6e2c696921ca4617661d07d0c454"
server_key_iv: "2282968aeef34973358dcdc77bfb548b"
server_key_version: "encryptionkey@0"
I20260812 06:24:10.596267 13016 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:24:10.596968 13046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:10.597118 13016 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:10.597205 13016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "8ee3defd9f5c425892fd862f94a0242e"
format_stamp: "Formatted at 2026-08-12 06:24:10 on dist-test-slave-gjrz"
server_key: "269e6e2c696921ca4617661d07d0c454"
server_key_iv: "2282968aeef34973358dcdc77bfb548b"
server_key_version: "encryptionkey@0"
I20260812 06:24:10.597275 13016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:10.607191 13016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:10.608855 13016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:10.608968 13016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:10.613368 13016 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:39035
I20260812 06:24:10.613426 13167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:39035 every 8 connection(s)
I20260812 06:24:10.613708 13016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:24:10.614367 13168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:10.616606 13168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e: Bootstrap starting.
I20260812 06:24:10.617167 13168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:10.617439 13168 log.cc:824] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:10.618122 13168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e: No bootstrap required, opened a new log
I20260812 06:24:10.620183 13168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ee3defd9f5c425892fd862f94a0242e" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39035 } }
I20260812 06:24:10.620314 13168 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:10.620337 13168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee3defd9f5c425892fd862f94a0242e, State: Initialized, Role: FOLLOWER
I20260812 06:24:10.620455 13168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ee3defd9f5c425892fd862f94a0242e" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39035 } }
I20260812 06:24:10.620523 13168 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:24:10.620555 13168 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:24:10.620600 13168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:10.621096 13168 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ee3defd9f5c425892fd862f94a0242e" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39035 } }
I20260812 06:24:10.621183 13168 leader_election.cc:302] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ee3defd9f5c425892fd862f94a0242e; no voters:
I20260812 06:24:10.621342 13168 leader_election.cc:288] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:24:10.621382 13174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:10.621490 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 13016
I20260812 06:24:10.621519 13174 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [term 1 LEADER]: Becoming Leader. State: Replica: 8ee3defd9f5c425892fd862f94a0242e, State: Running, Role: LEADER
I20260812 06:24:10.621596 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:24:10.621605 13174 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ee3defd9f5c425892fd862f94a0242e" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39035 } }
I20260812 06:24:10.621727 13168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:24:10.621796 30781 external_mini_cluster.cc:1428] Setting key 0cb4440643430be06c3d4c372dfaee7e
I20260812 06:24:10.622020 13175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ee3defd9f5c425892fd862f94a0242e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ee3defd9f5c425892fd862f94a0242e" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39035 } } }
I20260812 06:24:10.622116 13175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:10.622033 13177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ee3defd9f5c425892fd862f94a0242e. Latest consensus state: current_term: 1 leader_uuid: "8ee3defd9f5c425892fd862f94a0242e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ee3defd9f5c425892fd862f94a0242e" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39035 } } }
I20260812 06:24:10.622298 13177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:10.622795 13182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:24:10.623328 13182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:24:10.624890 13182 catalog_manager.cc:1347] Generated new cluster ID: e8eae2becbb74b558ee6946104caef32
I20260812 06:24:10.624943 13182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:24:10 dist-test-slave-gjrz krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:10.631453 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:10.622431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41382 (local address 127.30.15.126:39035)
0812 06:24:10.622948 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:10.622958 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:10.622992 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:24:10.623116 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:10.623123 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:10.623184 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:10.624067 (+ 883us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:10.624156 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.625256 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.625986 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.626408 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.626509 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:10.628638 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:10.628642 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:10.628642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:10.628652 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:10.630081 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:10.630396 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:10.630400 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:10.630400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:10.630481 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:10.630653 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:10.630653 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:10.630654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:10.630871 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:10.631025 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:10.631117 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 06:24:10.631249 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":85,"threads_started":1}
I20260812 06:24:10.635711 13182 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:24:10.636377 13182 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:24:10.650494 13182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e: Generated new TSK 0
I20260812 06:24:10.650684 13182 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab.
Entry for principal oryx/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab.
I20260812 06:24:10.686620 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39035
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab
--principal=oryx/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:39791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:10.800414 13220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:10.800596 13220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:10.800618 13220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:10.801750 13220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:10.801791 13220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:10.801811 13220 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:24:10.801831 13220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:24:10.803344 13220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab
--principal=oryx/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.15.126:39035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:10.803551 13220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:10.803768 13220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:10.808447 13228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:10.808471 13220 server_base.cc:1034] running on GCE node
W20260812 06:24:10.808401 13236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:10.808388 13229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:10.808772 13220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:10.809007 13220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:10.810159 13220 hybrid_clock.cc:648] HybridClock initialized: now 1786515850810148 us; error 27 us; skew 500 ppm
Aug 12 06:24:10 dist-test-slave-gjrz krb5kdc[12986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515850, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:10.812526 13220 init.cc:377] Logged in from keytab as oryx/127.30.15.65@KRBTEST.COM (short username oryx)
I20260812 06:24:10.812903 13220 webserver.cc:460] Webserver started at http://127.30.15.65:40477/ using document root <none> and password file <none>
I20260812 06:24:10.813108 13220 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:10.813155 13220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:10.813278 13220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:10.814222 13220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "929137514e4b422a819412ff64fb8b4f"
format_stamp: "Formatted at 2026-08-12 06:24:10 on dist-test-slave-gjrz"
server_key: "f13d26af699f766ee26d80eb9b5cfbb2"
server_key_iv: "e4553b47a57bb24aa2eaaca514f87c2e"
server_key_version: "encryptionkey@0"
I20260812 06:24:10.814543 13220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "929137514e4b422a819412ff64fb8b4f"
format_stamp: "Formatted at 2026-08-12 06:24:10 on dist-test-slave-gjrz"
server_key: "f13d26af699f766ee26d80eb9b5cfbb2"
server_key_iv: "e4553b47a57bb24aa2eaaca514f87c2e"
server_key_version: "encryptionkey@0"
I20260812 06:24:10.815821 13220 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:24:10.816529 13248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:10.816699 13220 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:10.816773 13220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "929137514e4b422a819412ff64fb8b4f"
format_stamp: "Formatted at 2026-08-12 06:24:10 on dist-test-slave-gjrz"
server_key: "f13d26af699f766ee26d80eb9b5cfbb2"
server_key_iv: "e4553b47a57bb24aa2eaaca514f87c2e"
server_key_version: "encryptionkey@0"
I20260812 06:24:10.816834 13220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:10.836814 13220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:10.838393 13220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:10.838528 13220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:10.838970 13220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:10.839011 13220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:10.839040 13220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:10.839056 13220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:24:10 dist-test-slave-gjrz krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515850, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:10.845541 13220 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:37249
I20260812 06:24:10.845592 13474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:37249 every 8 connection(s)
I20260812 06:24:10.845927 13220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:24:10.848299 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:10.839389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:34143 (local address 127.30.15.126:39035)
0812 06:24:10.839456 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:10.839458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:10.839618 (+ 160us) server_negotiation.cc:407] Connection header received
0812 06:24:10.840081 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:10.840083 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:10.840096 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:10.840146 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:10.840812 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.841572 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.843114 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.843448 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.843526 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:10.846030 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:10.846031 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:10.846032 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:10.846039 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:10.847254 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:10.847621 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:10.847622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:10.847622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:10.847671 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:10.847840 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:10.847841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:10.847841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:10.847931 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:10.847976 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:10.848177 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 06:24:10.848237 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:24:10.848426 13277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:10.839366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39035 (local address 127.30.15.65:34143)
0812 06:24:10.839504 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:10.839541 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:10.839982 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:10.840208 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:10.840212 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:10.840474 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:10.840696 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:10.840701 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.841677 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.841678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:10.843009 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:10.843013 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.843546 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.843547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:10.843686 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:10.844124 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:10.844133 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:10.845874 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:10.847340 (+ 1466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:10.847348 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:10.847350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:10.847562 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:10.847708 (+ 146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:10.847709 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:10.847709 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:10.847802 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:10.847973 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:10.847976 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:10.848077 (+ 101us) client_negotiation.cc:769] Sending connection context
0812 06:24:10.848158 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 06:24:10.848266 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":73,"threads_started":1}
I20260812 06:24:10.848893 13482 heartbeater.cc:347] Connected to a master server at 127.30.15.126:39035
I20260812 06:24:10.848995 13482 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:10.849169 13482 heartbeater.cc:511] Master 127.30.15.126:39035 requested a full tablet report, sending...
I20260812 06:24:10.849628 13077 ts_manager.cc:194] Registered new tserver with Master: 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249)
I20260812 06:24:10.850361 13077 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:34143
I20260812 06:24:10.852135 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 13220
I20260812 06:24:10.852257 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:24:10.852458 30781 external_mini_cluster.cc:1428] Setting key db170c8543b55c44c847aac1b176d198
I20260812 06:24:10.854946 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:10.849814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:36341 (local address 127.30.15.126:39035)
0812 06:24:10.849853 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:10.849855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:10.849926 (+ 71us) server_negotiation.cc:407] Connection header received
0812 06:24:10.849973 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:10.849973 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:10.849981 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:10.850039 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:10.850295 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.850877 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.851653 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.851840 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.851888 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:10.852766 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:10.852767 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:10.852767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:10.852773 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:10.853996 (+ 1223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:10.854287 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:10.854288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:10.854289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:10.854337 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:10.854496 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:10.854497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:10.854497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:10.854595 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:10.854649 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:10.854793 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 06:24:10.854859 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:24:10.854959 13492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:10.849770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39035 (local address 127.30.15.65:36341)
0812 06:24:10.849878 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:10.849887 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:10.849936 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:10.850043 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:10.850049 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:10.850193 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:10.850245 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:10.850246 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.850966 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.850967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:10.851582 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:10.851586 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.851894 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.851895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:10.851940 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:10.852319 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:10.852324 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:10.852647 (+ 323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:10.854077 (+ 1430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:10.854078 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:10.854078 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:10.854228 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:10.854389 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:10.854390 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:10.854390 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:10.854446 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:10.854650 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:10.854651 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:10.854706 (+ 55us) client_negotiation.cc:769] Sending connection context
0812 06:24:10.854763 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:24:10.854859 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":63,"threads_started":1}
WARNING: no policy specified for oryx/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab.
Entry for principal oryx/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab.
I20260812 06:24:10.875658 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39035
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab
--principal=oryx/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:39791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:10.954924 13500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:10.955103 13500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:10.955125 13500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:10.956260 13500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:10.956301 13500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:10.956321 13500 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:24:10.956350 13500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:24:10.957795 13500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab
--principal=oryx/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.15.126:39035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:10.957991 13500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:10.958185 13500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:10.962739 13508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:10.962754 13510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:10.962800 13500 server_base.cc:1034] running on GCE node
W20260812 06:24:10.962718 13516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:10.963011 13500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:10.963248 13500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:10.964417 13500 hybrid_clock.cc:648] HybridClock initialized: now 1786515850964400 us; error 33 us; skew 500 ppm
Aug 12 06:24:10 dist-test-slave-gjrz krb5kdc[12986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515850, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:10.966732 13500 init.cc:377] Logged in from keytab as oryx/127.30.15.66@KRBTEST.COM (short username oryx)
I20260812 06:24:10.967140 13500 webserver.cc:460] Webserver started at http://127.30.15.66:34197/ using document root <none> and password file <none>
I20260812 06:24:10.967367 13500 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:10.967417 13500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:10.967536 13500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:10.968474 13500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "943a8e1e04904bec90a115fd5e295607"
format_stamp: "Formatted at 2026-08-12 06:24:10 on dist-test-slave-gjrz"
server_key: "53a3ff42a1a3a98a7946c60f469863db"
server_key_iv: "07cb8e94d880145e269badbee88b9eac"
server_key_version: "encryptionkey@0"
I20260812 06:24:10.968801 13500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "943a8e1e04904bec90a115fd5e295607"
format_stamp: "Formatted at 2026-08-12 06:24:10 on dist-test-slave-gjrz"
server_key: "53a3ff42a1a3a98a7946c60f469863db"
server_key_iv: "07cb8e94d880145e269badbee88b9eac"
server_key_version: "encryptionkey@0"
I20260812 06:24:10.970026 13500 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:24:10.970705 13527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:10.970856 13500 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:24:10.970935 13500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "943a8e1e04904bec90a115fd5e295607"
format_stamp: "Formatted at 2026-08-12 06:24:10 on dist-test-slave-gjrz"
server_key: "53a3ff42a1a3a98a7946c60f469863db"
server_key_iv: "07cb8e94d880145e269badbee88b9eac"
server_key_version: "encryptionkey@0"
I20260812 06:24:10.971004 13500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:10.985952 13500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:10.987651 13500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:10.987769 13500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:10.988233 13500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:10.988272 13500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:10.988297 13500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:10.988328 13500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:24:10 dist-test-slave-gjrz krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515850, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:10.995152 13500 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:44265
I20260812 06:24:10.995507 13500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:24:10.995249 13732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:44265 every 8 connection(s)
I20260812 06:24:10.996978 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:10.988579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:46321 (local address 127.30.15.126:39035)
0812 06:24:10.988639 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:10.988641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:10.988818 (+ 177us) server_negotiation.cc:407] Connection header received
0812 06:24:10.989249 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:10.989251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:10.989263 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:10.989335 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:10.989935 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.990678 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.991886 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.992190 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.992267 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:10.994601 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:10.994602 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:10.994602 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:10.994610 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:10.996031 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:10.996340 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:10.996341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:10.996341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:10.996389 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:10.996540 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:10.996540 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:10.996541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:10.996634 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:10.996676 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:10.996856 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 06:24:10.996912 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:24:10.997112 13541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:10.988557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39035 (local address 127.30.15.66:46321)
0812 06:24:10.988703 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:10.988741 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:10.989167 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:10.989388 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:10.989391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:10.989650 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:10.989857 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:10.989862 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.990777 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.990778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:10.991814 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:10.991817 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.992282 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.992283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:10.992404 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:10.992864 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:10.992874 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:10.994504 (+ 1630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:10.996086 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:10.996089 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:10.996090 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:10.996284 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:10.996424 (+ 140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:10.996425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:10.996425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:10.996502 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:10.996668 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:10.996671 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:10.996769 (+ 98us) client_negotiation.cc:769] Sending connection context
0812 06:24:10.996839 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:24:10.996945 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":72,"threads_started":1}
I20260812 06:24:10.997562 13733 heartbeater.cc:347] Connected to a master server at 127.30.15.126:39035
I20260812 06:24:10.997640 13733 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:10.997800 13733 heartbeater.cc:511] Master 127.30.15.126:39035 requested a full tablet report, sending...
I20260812 06:24:10.998171 13081 ts_manager.cc:194] Registered new tserver with Master: 943a8e1e04904bec90a115fd5e295607 (127.30.15.66:44265)
I20260812 06:24:10.998529 13081 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:46321
I20260812 06:24:10.999891 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 13500
I20260812 06:24:11.000002 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:24:11.000182 30781 external_mini_cluster.cc:1428] Setting key 7989d5688b8983a0536cec256cb249f1
I20260812 06:24:11.003857 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:10.998558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:54879 (local address 127.30.15.126:39035)
0812 06:24:10.998610 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:10.998612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:10.998793 (+ 181us) server_negotiation.cc:407] Connection header received
0812 06:24:10.998811 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:10.998812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:10.998820 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:10.998863 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:10.999185 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.999730 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.000603 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.000826 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.000901 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.001639 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:11.001641 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:11.001641 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:11.001648 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:11.002831 (+ 1183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:11.003126 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:11.003127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:11.003127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:11.003180 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:11.003355 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:11.003356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:11.003356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:11.003498 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:11.003568 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.003707 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.003771 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:24:11.003870 13743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:10.998492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39035 (local address 127.30.15.66:54879)
0812 06:24:10.998611 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:10.998621 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:10.998675 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:10.998879 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:10.998880 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:10.999066 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:10.999120 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:10.999122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:10.999809 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:10.999810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.000532 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.000534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.000900 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.000901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.000958 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.001300 (+ 342us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:11.001303 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:11.001563 (+ 260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:11.002902 (+ 1339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:11.002903 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:11.002904 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:11.003065 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:11.003234 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:11.003235 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:11.003235 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:11.003309 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:11.003558 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:11.003558 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:11.003616 (+ 58us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.003678 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.003773 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":67,"threads_started":1}
WARNING: no policy specified for oryx/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab.
Entry for principal oryx/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab.
I20260812 06:24:11.023559 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39035
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab
--principal=oryx/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:39791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:11.102854 13747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:11.103049 13747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:11.103080 13747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:11.104200 13747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:11.104240 13747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:11.104267 13747 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:24:11.104291 13747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:24:11.105924 13747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab
--principal=oryx/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.15.126:39035
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:11.106184 13747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:11.106376 13747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:11.111162 13755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:11.111158 13758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:11.111198 13747 server_base.cc:1034] running on GCE node
W20260812 06:24:11.111294 13754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:11.111603 13747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:11.111796 13747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:11.112931 13747 hybrid_clock.cc:648] HybridClock initialized: now 1786515851112916 us; error 28 us; skew 500 ppm
Aug 12 06:24:11 dist-test-slave-gjrz krb5kdc[12986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515851, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:11.115367 13747 init.cc:377] Logged in from keytab as oryx/127.30.15.67@KRBTEST.COM (short username oryx)
I20260812 06:24:11.115769 13747 webserver.cc:460] Webserver started at http://127.30.15.67:43111/ using document root <none> and password file <none>
I20260812 06:24:11.115957 13747 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:11.116001 13747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:11.116117 13747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:11.117085 13747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "a693cc92257d49d89db1c2cb74763092"
format_stamp: "Formatted at 2026-08-12 06:24:11 on dist-test-slave-gjrz"
server_key: "3c46e9660fe2926ca819f839c0919e9c"
server_key_iv: "5cc0dd9f4aad29f5cf330fb5cde3dbed"
server_key_version: "encryptionkey@0"
I20260812 06:24:11.117414 13747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "a693cc92257d49d89db1c2cb74763092"
format_stamp: "Formatted at 2026-08-12 06:24:11 on dist-test-slave-gjrz"
server_key: "3c46e9660fe2926ca819f839c0919e9c"
server_key_iv: "5cc0dd9f4aad29f5cf330fb5cde3dbed"
server_key_version: "encryptionkey@0"
I20260812 06:24:11.118635 13747 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:24:11.119357 13767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:11.119557 13747 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:24:11.119663 13747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "a693cc92257d49d89db1c2cb74763092"
format_stamp: "Formatted at 2026-08-12 06:24:11 on dist-test-slave-gjrz"
server_key: "3c46e9660fe2926ca819f839c0919e9c"
server_key_iv: "5cc0dd9f4aad29f5cf330fb5cde3dbed"
server_key_version: "encryptionkey@0"
I20260812 06:24:11.119728 13747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:11.136631 13747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:11.138278 13747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:11.138399 13747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:11.138875 13747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:11.138912 13747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:11.138938 13747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:11.138955 13747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 06:24:11 dist-test-slave-gjrz krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515851, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:11.145818 13747 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:38923
I20260812 06:24:11.145895 13959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:38923 every 8 connection(s)
I20260812 06:24:11.146154 13747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:24:11.147675 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 13747
I20260812 06:24:11.147765 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:24:11.147957 30781 external_mini_cluster.cc:1428] Setting key 166cc34c25c8b8468233d213eabbb4b6
I20260812 06:24:11.148720 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.139297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:49255 (local address 127.30.15.126:39035)
0812 06:24:11.139338 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.139340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.139575 (+ 235us) server_negotiation.cc:407] Connection header received
0812 06:24:11.140053 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.140054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.140069 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.140141 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:11.140794 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.141553 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.143014 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.143328 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.143407 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.145880 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:11.145882 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:11.145882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:11.145891 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:11.147250 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:11.147685 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:11.147686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:11.147686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:11.147737 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:11.148037 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:11.148039 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:11.148039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:11.148172 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:11.148239 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.148534 (+ 295us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.148629 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:24:11.148864 13783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.139313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39035 (local address 127.30.15.67:49255)
0812 06:24:11.139458 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:11.139497 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:11.139948 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:11.140194 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:11.140199 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:11.140497 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:11.140716 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.140721 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.141647 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.141649 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.142915 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.142918 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.143430 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.143432 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.143559 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.143996 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:11.144022 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:11.145777 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:11.147336 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:11.147342 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:11.147344 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:11.147617 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:11.147819 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:11.147820 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:11.147820 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:11.147954 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:11.148239 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:11.148246 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:11.148397 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.148505 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.148661 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":75,"threads_started":1}
I20260812 06:24:11.149268 13960 heartbeater.cc:347] Connected to a master server at 127.30.15.126:39035
I20260812 06:24:11.149350 13960 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:11.149510 13960 heartbeater.cc:511] Master 127.30.15.126:39035 requested a full tablet report, sending...
I20260812 06:24:11.149895 13081 ts_manager.cc:194] Registered new tserver with Master: a693cc92257d49d89db1c2cb74763092 (127.30.15.67:38923)
I20260812 06:24:11.150341 13081 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:49255
I20260812 06:24:11.154949 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.150256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:56893 (local address 127.30.15.126:39035)
0812 06:24:11.150293 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.150294 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.150434 (+ 140us) server_negotiation.cc:407] Connection header received
0812 06:24:11.150516 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.150517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.150527 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.150581 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:11.150894 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.151403 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.152077 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.152280 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.152332 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.153056 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:11.153057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:11.153058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:11.153064 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:11.154010 (+ 946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:11.154293 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:11.154294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:11.154295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:11.154348 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:11.154509 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:11.154510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:11.154510 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:11.154611 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:11.154665 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.154795 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.154862 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:24:11.154961 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.150177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39035 (local address 127.30.15.67:56893)
0812 06:24:11.150373 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:11.150381 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:11.150459 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:11.150585 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:11.150586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:11.150744 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:11.150823 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.150824 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.151484 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.151485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.152008 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.152009 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.152338 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.152339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.152406 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.152719 (+ 313us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:11.152722 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:11.152981 (+ 259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:11.154079 (+ 1098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:11.154080 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:11.154080 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:11.154234 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:11.154400 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:11.154400 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:11.154401 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:11.154457 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:11.154662 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:11.154663 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:11.154708 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.154768 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.154863 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":67,"threads_started":1}
I20260812 06:24:11.159487 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 06:24:11 dist-test-slave-gjrz krb5kdc[12986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515851, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 06:24:11 dist-test-slave-gjrz krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:11 dist-test-slave-gjrz krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:24:11.179943 13193 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:11.175203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41390 (local address 127.30.15.126:39035)
0812 06:24:11.175258 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.175281 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.175290 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:24:11.175347 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.175348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.175358 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.175404 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:11.175909 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.176383 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.177057 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.177224 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.177263 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.179872 (+ 2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41390: BlockingRecv error: recv got EOF from 127.0.0.1:41390 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 12 06:24:11 dist-test-slave-gjrz krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515851, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:11.186332 13193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.180684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41398 (local address 127.30.15.126:39035)
0812 06:24:11.180721 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.180722 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.180751 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:24:11.180800 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.180801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.180809 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.180848 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:11.181241 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.181668 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.182361 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.182549 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.182587 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.184414 (+ 1827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:11.184416 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:11.184416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:11.184422 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:11.185569 (+ 1147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:11.185825 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:11.185826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:11.185826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:11.185869 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:11.185986 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:11.185987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:11.185987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:11.186083 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:11.186147 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.186224 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.186277 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:24:11.187695 13081 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41398:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:24:11.189219 13081 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:24:11.195782 14007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.192065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43964 (local address 127.30.15.67:38923)
0812 06:24:11.192252 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.192256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.192588 (+ 332us) server_negotiation.cc:407] Connection header received
0812 06:24:11.192629 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.192631 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.192645 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.192714 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:11.192817 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.193794 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.194811 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.195393 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.195457 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.195532 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.195661 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.195695 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":112,"threads_started":1}
I20260812 06:24:11.195770 14003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.191859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:38923 (local address 127.0.0.1:43964)
0812 06:24:11.192478 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:11.192487 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:11.192533 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:11.192725 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:11.192726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:11.192728 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:11.192765 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.192767 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.193863 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.193864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.194739 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.194741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.195469 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.195470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.195551 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.195565 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.195627 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.195687 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":48,"threads_started":1}
I20260812 06:24:11.195951 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.191801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50854 (local address 127.30.15.66:44265)
0812 06:24:11.191989 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.191994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.192056 (+ 62us) server_negotiation.cc:407] Connection header received
0812 06:24:11.192151 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.192153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.192168 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.192238 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:11.192445 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.193262 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.194576 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.195322 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.195384 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.195465 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.195814 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.195861 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":95,"threads_started":1}
I20260812 06:24:11.196170 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.191801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47294 (local address 127.30.15.65:37249)
0812 06:24:11.192236 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.192240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.192250 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:24:11.192287 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.192289 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.192302 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.192373 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:11.192517 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.193613 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.194848 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.195611 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.195935 (+ 324us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.196031 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.196059 (+ 28us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.196099 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":117,"threads_started":1}
I20260812 06:24:11.195868 13996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.191678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:37249 (local address 127.0.0.1:47294)
0812 06:24:11.192011 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:11.192022 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:11.192079 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:11.192390 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:11.192391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:11.192392 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:11.192438 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.192440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.193698 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.193699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.194757 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.194760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.195694 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.195695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.195752 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.195755 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.195781 (+ 26us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.195813 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":5,"thread_start_us":64,"threads_started":1}
I20260812 06:24:11.195775 13998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.191677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:44265 (local address 127.0.0.1:50854)
0812 06:24:11.191968 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:11.192008 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:11.192075 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:11.192315 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:11.192318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:11.192320 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:11.192368 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.192369 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.193331 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.193332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.194476 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.194479 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.195501 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.195502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.195588 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.195593 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.195646 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.195693 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":2,"thread_start_us":57,"threads_started":1}
I20260812 06:24:11.196868 13858 tablet_service.cc:1467] Processing CreateTablet for tablet be751d9e97dd43f3a54c427780ac2b1d (DEFAULT_TABLE table=test-table [id=000a61e3bfa246908b3bd3a87a80366a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:11.196864 13352 tablet_service.cc:1467] Processing CreateTablet for tablet be751d9e97dd43f3a54c427780ac2b1d (DEFAULT_TABLE table=test-table [id=000a61e3bfa246908b3bd3a87a80366a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:11.196866 13613 tablet_service.cc:1467] Processing CreateTablet for tablet be751d9e97dd43f3a54c427780ac2b1d (DEFAULT_TABLE table=test-table [id=000a61e3bfa246908b3bd3a87a80366a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:11.197234 13613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be751d9e97dd43f3a54c427780ac2b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:11.197234 13352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be751d9e97dd43f3a54c427780ac2b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:11.197235 13858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be751d9e97dd43f3a54c427780ac2b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:11.201057 14009 tablet_bootstrap.cc:492] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607: Bootstrap starting.
I20260812 06:24:11.201133 14008 tablet_bootstrap.cc:492] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092: Bootstrap starting.
I20260812 06:24:11.201618 14009 tablet_bootstrap.cc:654] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:11.201658 14008 tablet_bootstrap.cc:654] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:11.201928 14008 log.cc:824] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:11.201929 14009 log.cc:824] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:11.202227 14011 tablet_bootstrap.cc:492] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f: Bootstrap starting.
I20260812 06:24:11.202643 14009 tablet_bootstrap.cc:492] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607: No bootstrap required, opened a new log
I20260812 06:24:11.202705 14009 ts_tablet_manager.cc:1397] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:24:11.202754 14011 tablet_bootstrap.cc:654] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:11.202893 14008 tablet_bootstrap.cc:492] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092: No bootstrap required, opened a new log
I20260812 06:24:11.202962 14008 ts_tablet_manager.cc:1397] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:24:11.203095 14011 log.cc:824] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:11.203871 14011 tablet_bootstrap.cc:492] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f: No bootstrap required, opened a new log
I20260812 06:24:11.203944 14011 ts_tablet_manager.cc:1397] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:24:11.204452 14009 raft_consensus.cc:348] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.204586 14009 raft_consensus.cc:374] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:11.204617 14009 raft_consensus.cc:729] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943a8e1e04904bec90a115fd5e295607, State: Initialized, Role: FOLLOWER
I20260812 06:24:11.204748 14009 consensus_queue.cc:260] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.204986 14009 ts_tablet_manager.cc:1428] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:24:11.204890 14008 raft_consensus.cc:348] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.205032 14008 raft_consensus.cc:374] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:11.205075 14008 raft_consensus.cc:729] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a693cc92257d49d89db1c2cb74763092, State: Initialized, Role: FOLLOWER
I20260812 06:24:11.205096 13733 heartbeater.cc:503] Master 127.30.15.126:39035 was elected leader, sending a full tablet report...
I20260812 06:24:11.205184 14008 consensus_queue.cc:260] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.205564 14008 ts_tablet_manager.cc:1428] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:24:11.205583 13960 heartbeater.cc:503] Master 127.30.15.126:39035 was elected leader, sending a full tablet report...
I20260812 06:24:11.205871 14011 raft_consensus.cc:348] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.206019 14011 raft_consensus.cc:374] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:11.206061 14011 raft_consensus.cc:729] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929137514e4b422a819412ff64fb8b4f, State: Initialized, Role: FOLLOWER
I20260812 06:24:11.206166 14011 consensus_queue.cc:260] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.206451 13482 heartbeater.cc:503] Master 127.30.15.126:39035 was elected leader, sending a full tablet report...
I20260812 06:24:11.206434 14011 ts_tablet_manager.cc:1428] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260812 06:24:11.246042 13734 tablet.cc:2369] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:24:11.346674 13483 tablet.cc:2369] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:24:11.396699 13962 tablet.cc:2369] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:24:11.521612 14022 raft_consensus.cc:482] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:24:11.521727 14022 raft_consensus.cc:504] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.522095 14022 leader_election.cc:288] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249), a693cc92257d49d89db1c2cb74763092 (127.30.15.67:38923)
I20260812 06:24:11.525141 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.522351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:49033 (local address 127.30.15.65:37249)
0812 06:24:11.522401 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.522403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.522467 (+ 64us) server_negotiation.cc:407] Connection header received
0812 06:24:11.522591 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.522592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.522603 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.522634 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:11.522841 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.523485 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.524465 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.524829 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.524890 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.524899 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.525034 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.525073 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:24:11.525158 14007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.522562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:46043 (local address 127.30.15.67:38923)
0812 06:24:11.522604 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.522605 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.522664 (+ 59us) server_negotiation.cc:407] Connection header received
0812 06:24:11.522752 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.522753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.522762 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.522810 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:11.523008 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.523598 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.524480 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.524844 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.524903 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.524911 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.525056 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.525093 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:24:11.525161 14026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.522288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:37249 (local address 127.30.15.66:49033)
0812 06:24:11.522404 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:11.522415 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:11.522480 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:11.522710 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:11.522711 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:11.522714 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:11.522778 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.522780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.523566 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.523567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.524376 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.524378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.524898 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.524899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.524973 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.524976 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.525020 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.525069 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":62,"threads_started":1}
I20260812 06:24:11.525174 14032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.522461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:38923 (local address 127.30.15.66:46043)
0812 06:24:11.522581 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:11.522593 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:11.522683 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:11.522818 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:11.522819 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:11.522821 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:11.522904 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.522906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.523676 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.523677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.524394 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.524396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.524919 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.524920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.524993 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.524996 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.525041 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.525080 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":93,"threads_started":1}
I20260812 06:24:11.525754 13892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be751d9e97dd43f3a54c427780ac2b1d" candidate_uuid: "943a8e1e04904bec90a115fd5e295607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a693cc92257d49d89db1c2cb74763092" is_pre_election: true
I20260812 06:24:11.525759 13390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be751d9e97dd43f3a54c427780ac2b1d" candidate_uuid: "943a8e1e04904bec90a115fd5e295607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929137514e4b422a819412ff64fb8b4f" is_pre_election: true
I20260812 06:24:11.525883 13390 raft_consensus.cc:2454] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 943a8e1e04904bec90a115fd5e295607 in term 0.
I20260812 06:24:11.525884 13892 raft_consensus.cc:2454] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 943a8e1e04904bec90a115fd5e295607 in term 0.
I20260812 06:24:11.526108 13534 leader_election.cc:302] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 943a8e1e04904bec90a115fd5e295607, a693cc92257d49d89db1c2cb74763092; no voters:
I20260812 06:24:11.526242 14022 raft_consensus.cc:2781] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:24:11.526298 14022 raft_consensus.cc:482] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:24:11.526312 14022 raft_consensus.cc:3037] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:11.526993 14022 raft_consensus.cc:504] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.527102 14022 leader_election.cc:288] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [CANDIDATE]: Term 1 election: Requested vote from peers 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249), a693cc92257d49d89db1c2cb74763092 (127.30.15.67:38923)
I20260812 06:24:11.527318 13390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be751d9e97dd43f3a54c427780ac2b1d" candidate_uuid: "943a8e1e04904bec90a115fd5e295607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929137514e4b422a819412ff64fb8b4f"
I20260812 06:24:11.527367 13892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be751d9e97dd43f3a54c427780ac2b1d" candidate_uuid: "943a8e1e04904bec90a115fd5e295607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a693cc92257d49d89db1c2cb74763092"
I20260812 06:24:11.527402 13390 raft_consensus.cc:3037] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:11.527436 13892 raft_consensus.cc:3037] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:11.528085 13390 raft_consensus.cc:2454] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 943a8e1e04904bec90a115fd5e295607 in term 1.
I20260812 06:24:11.528188 13892 raft_consensus.cc:2454] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 943a8e1e04904bec90a115fd5e295607 in term 1.
I20260812 06:24:11.528241 13534 leader_election.cc:302] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 929137514e4b422a819412ff64fb8b4f, 943a8e1e04904bec90a115fd5e295607; no voters:
I20260812 06:24:11.528326 14022 raft_consensus.cc:2781] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:11.528455 14022 raft_consensus.cc:686] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 1 LEADER]: Becoming Leader. State: Replica: 943a8e1e04904bec90a115fd5e295607, State: Running, Role: LEADER
I20260812 06:24:11.528542 14022 consensus_queue.cc:237] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.529345 13077 catalog_manager.cc:5495] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 reported cstate change: term changed from 0 to 1, leader changed from <none> to 943a8e1e04904bec90a115fd5e295607 (127.30.15.66). New cstate: current_term: 1 leader_uuid: "943a8e1e04904bec90a115fd5e295607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } health_report { overall_health: UNKNOWN } } }
I20260812 06:24:11.544414 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.542477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50868 (local address 127.30.15.66:44265)
0812 06:24:11.542517 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.542518 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.542527 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:24:11.542577 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.542577 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.542592 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.542646 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:24:11.542739 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.543154 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.543874 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.544044 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.544090 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.544207 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:24:11.544290 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:24:11.544341 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.544355 (+ 14us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.544369 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:24:11.545908 13892 raft_consensus.cc:1261] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Refusing update from remote peer 943a8e1e04904bec90a115fd5e295607: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:11.545917 13390 raft_consensus.cc:1261] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Refusing update from remote peer 943a8e1e04904bec90a115fd5e295607: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:11.546213 14022 consensus_queue.cc:1035] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:11.546348 14033 consensus_queue.cc:1035] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:11.549095 14039 mvcc.cc:205] Tried to move back new op lower bound from 7317568927929937920 to 7317568927861551104. Current Snapshot: MvccSnapshot[applied={T|T < 7317568927929937920 or (T in {7317568927929937920})}]
I20260812 06:24:11.549214 14038 mvcc.cc:205] Tried to move back new op lower bound from 7317568927929937920 to 7317568927861551104. Current Snapshot: MvccSnapshot[applied={T|T < 7317568927929937920}]
I20260812 06:24:11.550580 13077 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:11.550657 13077 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:11.551352 13077 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e: Sending DeleteTablet for 3 replicas of tablet be751d9e97dd43f3a54c427780ac2b1d
I20260812 06:24:11.551714 13352 tablet_service.cc:1514] Processing DeleteTablet for tablet be751d9e97dd43f3a54c427780ac2b1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:11 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:47294
I20260812 06:24:11.551717 13613 tablet_service.cc:1514] Processing DeleteTablet for tablet be751d9e97dd43f3a54c427780ac2b1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:11 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:50854
I20260812 06:24:11.551837 13858 tablet_service.cc:1514] Processing DeleteTablet for tablet be751d9e97dd43f3a54c427780ac2b1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:11 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:43964
I20260812 06:24:11.551942 14052 tablet_replica.cc:330] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607: stopping tablet replica
I20260812 06:24:11.552031 14052 raft_consensus.cc:2229] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:24:11.552157 14052 raft_consensus.cc:2258] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:11.552119 13077 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41398:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:24:11.552248 13077 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:24:11.552443 14053 tablet_replica.cc:330] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092: stopping tablet replica
I20260812 06:24:11.552536 14053 raft_consensus.cc:2229] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:11.552589 14052 ts_tablet_manager.cc:1905] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:11.553460 13352 tablet_service.cc:1467] Processing CreateTablet for tablet fdd2821e0f4645f6b38a5f090b40ab67 (DEFAULT_TABLE table=test-table [id=2e8c02c628fb420ca38176ffeea244f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:11.553498 13613 tablet_service.cc:1467] Processing CreateTablet for tablet fdd2821e0f4645f6b38a5f090b40ab67 (DEFAULT_TABLE table=test-table [id=2e8c02c628fb420ca38176ffeea244f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:11.553588 13613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdd2821e0f4645f6b38a5f090b40ab67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:11.553588 13352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdd2821e0f4645f6b38a5f090b40ab67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:11.554216 14052 ts_tablet_manager.cc:1918] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:24:11.554283 14052 log.cc:1196] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/be751d9e97dd43f3a54c427780ac2b1d
I20260812 06:24:11.554531 14052 ts_tablet_manager.cc:1939] T be751d9e97dd43f3a54c427780ac2b1d P 943a8e1e04904bec90a115fd5e295607: Deleting consensus metadata
I20260812 06:24:11.554888 14011 tablet_bootstrap.cc:492] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f: Bootstrap starting.
I20260812 06:24:11.555246 14011 tablet_bootstrap.cc:654] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:11.555593 14009 tablet_bootstrap.cc:492] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607: Bootstrap starting.
I20260812 06:24:11.555958 14009 tablet_bootstrap.cc:654] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:11.556375 13053 catalog_manager.cc:4841] TS 943a8e1e04904bec90a115fd5e295607 (127.30.15.66:44265): tablet be751d9e97dd43f3a54c427780ac2b1d (table test-table [id=000a61e3bfa246908b3bd3a87a80366a]) successfully deleted
I20260812 06:24:11.556669 14009 tablet_bootstrap.cc:492] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607: No bootstrap required, opened a new log
I20260812 06:24:11.556711 14009 ts_tablet_manager.cc:1397] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:11.556819 14009 raft_consensus.cc:348] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.556864 14009 raft_consensus.cc:374] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:11.556876 14009 raft_consensus.cc:729] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943a8e1e04904bec90a115fd5e295607, State: Initialized, Role: FOLLOWER
I20260812 06:24:11.556907 14009 consensus_queue.cc:260] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.556988 14009 ts_tablet_manager.cc:1428] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:11.557192 14011 tablet_bootstrap.cc:492] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f: No bootstrap required, opened a new log
I20260812 06:24:11.557243 14011 ts_tablet_manager.cc:1397] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:24:11.557395 14011 raft_consensus.cc:348] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.557448 14011 raft_consensus.cc:374] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:11.557466 14011 raft_consensus.cc:729] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929137514e4b422a819412ff64fb8b4f, State: Initialized, Role: FOLLOWER
I20260812 06:24:11.557508 14011 consensus_queue.cc:260] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.557610 14011 ts_tablet_manager.cc:1428] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:11.553270 14053 raft_consensus.cc:2258] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:11.556535 13858 tablet_service.cc:1467] Processing CreateTablet for tablet fdd2821e0f4645f6b38a5f090b40ab67 (DEFAULT_TABLE table=test-table [id=2e8c02c628fb420ca38176ffeea244f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:11.557901 13858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdd2821e0f4645f6b38a5f090b40ab67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:11.557997 14050 tablet_replica.cc:330] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f: stopping tablet replica
I20260812 06:24:11.558117 14050 raft_consensus.cc:2229] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:11.558210 14050 raft_consensus.cc:2258] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:11.558475 14053 ts_tablet_manager.cc:1905] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:11.559341 14008 tablet_bootstrap.cc:492] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092: Bootstrap starting.
I20260812 06:24:11.559746 14008 tablet_bootstrap.cc:654] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:11.559947 14053 ts_tablet_manager.cc:1918] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:24:11.560016 14053 log.cc:1196] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/be751d9e97dd43f3a54c427780ac2b1d
I20260812 06:24:11.560240 14053 ts_tablet_manager.cc:1939] T be751d9e97dd43f3a54c427780ac2b1d P a693cc92257d49d89db1c2cb74763092: Deleting consensus metadata
I20260812 06:24:11.560390 14008 tablet_bootstrap.cc:492] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092: No bootstrap required, opened a new log
I20260812 06:24:11.560437 14008 ts_tablet_manager.cc:1397] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:11.560590 14008 raft_consensus.cc:348] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.560619 13055 catalog_manager.cc:4841] TS a693cc92257d49d89db1c2cb74763092 (127.30.15.67:38923): tablet be751d9e97dd43f3a54c427780ac2b1d (table test-table [id=000a61e3bfa246908b3bd3a87a80366a]) successfully deleted
I20260812 06:24:11.560657 14008 raft_consensus.cc:374] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:11.560678 14008 raft_consensus.cc:729] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a693cc92257d49d89db1c2cb74763092, State: Initialized, Role: FOLLOWER
I20260812 06:24:11.560720 14008 consensus_queue.cc:260] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.560806 14008 ts_tablet_manager.cc:1428] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:11.560839 14050 ts_tablet_manager.cc:1905] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:11.562250 14050 ts_tablet_manager.cc:1918] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:24:11.562309 14050 log.cc:1196] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/wal/wals/be751d9e97dd43f3a54c427780ac2b1d
I20260812 06:24:11.562456 14050 ts_tablet_manager.cc:1939] T be751d9e97dd43f3a54c427780ac2b1d P 929137514e4b422a819412ff64fb8b4f: Deleting consensus metadata
I20260812 06:24:11.562779 13055 catalog_manager.cc:4841] TS 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249): tablet be751d9e97dd43f3a54c427780ac2b1d (table test-table [id=000a61e3bfa246908b3bd3a87a80366a]) successfully deleted
I20260812 06:24:11.687184 14023 raft_consensus.cc:482] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:24:11.687294 14023 raft_consensus.cc:504] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.687629 14023 leader_election.cc:288] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249), 943a8e1e04904bec90a115fd5e295607 (127.30.15.66:44265)
I20260812 06:24:11.690347 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.687858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:40265 (local address 127.30.15.66:44265)
0812 06:24:11.687903 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.687905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.687974 (+ 69us) server_negotiation.cc:407] Connection header received
0812 06:24:11.688041 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.688042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.688052 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.688099 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:11.688249 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.688718 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.689702 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.690042 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.690104 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.690113 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.690250 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.690283 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:24:11.690356 14006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.687890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:49909 (local address 127.30.15.65:37249)
0812 06:24:11.687933 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.687934 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.687973 (+ 39us) server_negotiation.cc:407] Connection header received
0812 06:24:11.688059 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.688060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.688069 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.688118 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:11.688253 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.688729 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.689701 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.690049 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.690111 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.690120 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.690254 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.690291 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:24:11.690375 14061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.687785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:37249 (local address 127.30.15.67:49909)
0812 06:24:11.687914 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:11.687926 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:11.687996 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:11.688120 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:11.688121 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:11.688123 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:11.688193 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.688195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.688811 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.688812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.689613 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.689615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.690124 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.690125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.690190 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.690196 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.690240 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.690281 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":35,"thread_start_us":63,"threads_started":1}
I20260812 06:24:11.690389 14062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.687792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:44265 (local address 127.30.15.67:40265)
0812 06:24:11.687919 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:11.687928 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:11.687989 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:11.688108 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:11.688109 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:11.688112 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:11.688188 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.688190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.688785 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.688786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.689618 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.689621 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.690111 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.690112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.690188 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.690191 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.690236 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.690276 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":37,"thread_start_us":61,"threads_started":1}
I20260812 06:24:11.690567 13390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdd2821e0f4645f6b38a5f090b40ab67" candidate_uuid: "a693cc92257d49d89db1c2cb74763092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929137514e4b422a819412ff64fb8b4f" is_pre_election: true
I20260812 06:24:11.690652 13390 raft_consensus.cc:2454] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a693cc92257d49d89db1c2cb74763092 in term 0.
I20260812 06:24:11.690732 13644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdd2821e0f4645f6b38a5f090b40ab67" candidate_uuid: "a693cc92257d49d89db1c2cb74763092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943a8e1e04904bec90a115fd5e295607" is_pre_election: true
I20260812 06:24:11.690820 13773 leader_election.cc:302] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 929137514e4b422a819412ff64fb8b4f, a693cc92257d49d89db1c2cb74763092; no voters:
I20260812 06:24:11.690857 13644 raft_consensus.cc:2454] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a693cc92257d49d89db1c2cb74763092 in term 0.
I20260812 06:24:11.691000 14023 raft_consensus.cc:2781] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:24:11.691038 14023 raft_consensus.cc:482] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:24:11.691051 14023 raft_consensus.cc:3037] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:11.691772 14023 raft_consensus.cc:504] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.691891 14023 leader_election.cc:288] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [CANDIDATE]: Term 1 election: Requested vote from peers 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249), 943a8e1e04904bec90a115fd5e295607 (127.30.15.66:44265)
I20260812 06:24:11.692022 13644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdd2821e0f4645f6b38a5f090b40ab67" candidate_uuid: "a693cc92257d49d89db1c2cb74763092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943a8e1e04904bec90a115fd5e295607"
I20260812 06:24:11.692042 13390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdd2821e0f4645f6b38a5f090b40ab67" candidate_uuid: "a693cc92257d49d89db1c2cb74763092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929137514e4b422a819412ff64fb8b4f"
I20260812 06:24:11.692099 13644 raft_consensus.cc:3037] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:11.692103 13390 raft_consensus.cc:3037] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:11.692822 13644 raft_consensus.cc:2454] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a693cc92257d49d89db1c2cb74763092 in term 1.
I20260812 06:24:11.692822 13390 raft_consensus.cc:2454] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a693cc92257d49d89db1c2cb74763092 in term 1.
I20260812 06:24:11.692981 13773 leader_election.cc:302] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 929137514e4b422a819412ff64fb8b4f, a693cc92257d49d89db1c2cb74763092; no voters:
I20260812 06:24:11.693069 14023 raft_consensus.cc:2781] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:11.693156 14023 raft_consensus.cc:686] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 1 LEADER]: Becoming Leader. State: Replica: a693cc92257d49d89db1c2cb74763092, State: Running, Role: LEADER
I20260812 06:24:11.693219 14023 consensus_queue.cc:237] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.693818 13077 catalog_manager.cc:5495] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 reported cstate change: term changed from 0 to 1, leader changed from <none> to a693cc92257d49d89db1c2cb74763092 (127.30.15.67). New cstate: current_term: 1 leader_uuid: "a693cc92257d49d89db1c2cb74763092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } health_report { overall_health: HEALTHY } } }
Aug 12 06:24:11 dist-test-slave-gjrz krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515850, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.126@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:11.722134 14082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.715850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41410 (local address 127.30.15.126:39035)
0812 06:24:11.715992 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.715993 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.716017 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:24:11.716079 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.716079 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.716088 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.716150 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:11.716571 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.717033 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.717668 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.717840 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.717879 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.719772 (+ 1893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:11.719774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:11.719774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:11.719780 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:11.721087 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:11.721416 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:11.721417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:11.721417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:11.721467 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:11.721663 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:11.721664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:11.721664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:11.721754 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:11.721799 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.721944 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.722061 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260812 06:24:11.722215 14079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.715791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39035 (local address 127.0.0.1:41410)
0812 06:24:11.715930 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:11.715943 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:11.716035 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:11.716166 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:11.716167 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:11.716468 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:11.716517 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.716520 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.717100 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.717101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.717617 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.717618 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.717882 (+ 264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.717883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.717916 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.718359 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:11.718363 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:11.719701 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:11.721167 (+ 1466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:11.721174 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:11.721176 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:11.721362 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:11.721540 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:11.721541 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:11.721541 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:11.721611 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:11.721797 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:11.721819 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:11.721860 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.721920 (+ 60us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.722114 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":65,"thread_start_us":73,"threads_started":1}
I20260812 06:24:11.724143 13077 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:41410:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 06:24:11.724351 13077 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:24:11.725595 13858 tablet_service.cc:1467] Processing CreateTablet for tablet 4555d76adabd452cab51222e3399998d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6f670ef0073e4cd49d938d98eecc878e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:24:11.725615 13613 tablet_service.cc:1467] Processing CreateTablet for tablet 4555d76adabd452cab51222e3399998d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6f670ef0073e4cd49d938d98eecc878e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:24:11.725735 13613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4555d76adabd452cab51222e3399998d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:11.725739 13858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4555d76adabd452cab51222e3399998d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:11.726807 14009 tablet_bootstrap.cc:492] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607: Bootstrap starting.
I20260812 06:24:11.726979 13352 tablet_service.cc:1467] Processing CreateTablet for tablet 4555d76adabd452cab51222e3399998d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6f670ef0073e4cd49d938d98eecc878e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:24:11.727098 13352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4555d76adabd452cab51222e3399998d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:11.727161 14009 tablet_bootstrap.cc:654] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:11.727711 14009 tablet_bootstrap.cc:492] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607: No bootstrap required, opened a new log
I20260812 06:24:11.727767 14009 ts_tablet_manager.cc:1397] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:11.727882 14009 raft_consensus.cc:348] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } }
I20260812 06:24:11.727955 14009 raft_consensus.cc:374] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:11.727991 14009 raft_consensus.cc:729] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943a8e1e04904bec90a115fd5e295607, State: Initialized, Role: FOLLOWER
I20260812 06:24:11.728041 14009 consensus_queue.cc:260] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } }
I20260812 06:24:11.728134 14009 ts_tablet_manager.cc:1428] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:11.728533 14011 tablet_bootstrap.cc:492] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f: Bootstrap starting.
I20260812 06:24:11.728561 14008 tablet_bootstrap.cc:492] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: Bootstrap starting.
I20260812 06:24:11.728955 14008 tablet_bootstrap.cc:654] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:11.728955 14011 tablet_bootstrap.cc:654] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:11.729390 14044 tablet_replica.cc:439] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } }
I20260812 06:24:11.729492 14044 tablet_replica.cc:442] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:24:11.729588 14011 tablet_bootstrap.cc:492] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f: No bootstrap required, opened a new log
I20260812 06:24:11.729636 14011 ts_tablet_manager.cc:1397] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:11.729771 14011 raft_consensus.cc:348] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } }
I20260812 06:24:11.729827 14011 raft_consensus.cc:374] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:11.729846 14011 raft_consensus.cc:729] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929137514e4b422a819412ff64fb8b4f, State: Initialized, Role: FOLLOWER
I20260812 06:24:11.729887 14011 consensus_queue.cc:260] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } }
I20260812 06:24:11.729981 14011 ts_tablet_manager.cc:1428] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:11.730041 14024 tablet_replica.cc:439] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } }
I20260812 06:24:11.730144 14024 tablet_replica.cc:442] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:24:11.730249 14008 tablet_bootstrap.cc:492] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: No bootstrap required, opened a new log
I20260812 06:24:11.730293 14008 ts_tablet_manager.cc:1397] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:24:11.730433 14008 raft_consensus.cc:348] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } }
I20260812 06:24:11.730511 14008 raft_consensus.cc:374] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:11.730531 14008 raft_consensus.cc:729] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a693cc92257d49d89db1c2cb74763092, State: Initialized, Role: FOLLOWER
I20260812 06:24:11.730569 14008 consensus_queue.cc:260] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } }
I20260812 06:24:11.730657 14008 ts_tablet_manager.cc:1428] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:11.730710 14023 tablet_replica.cc:439] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } }
I20260812 06:24:11.730804 14023 tablet_replica.cc:442] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:24:11.777943 14023 raft_consensus.cc:482] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:24:11.778012 14023 raft_consensus.cc:504] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } }
I20260812 06:24:11.778134 14023 leader_election.cc:288] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 943a8e1e04904bec90a115fd5e295607 (127.30.15.66:44265), 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249)
I20260812 06:24:11.778293 13644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4555d76adabd452cab51222e3399998d" candidate_uuid: "a693cc92257d49d89db1c2cb74763092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943a8e1e04904bec90a115fd5e295607" is_pre_election: true
I20260812 06:24:11.778395 13644 raft_consensus.cc:2454] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a693cc92257d49d89db1c2cb74763092 in term 0.
I20260812 06:24:11.778373 13390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4555d76adabd452cab51222e3399998d" candidate_uuid: "a693cc92257d49d89db1c2cb74763092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929137514e4b422a819412ff64fb8b4f" is_pre_election: true
I20260812 06:24:11.778458 13390 raft_consensus.cc:2454] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a693cc92257d49d89db1c2cb74763092 in term 0.
I20260812 06:24:11.778564 13772 leader_election.cc:302] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 943a8e1e04904bec90a115fd5e295607, a693cc92257d49d89db1c2cb74763092; no voters:
I20260812 06:24:11.778662 14023 raft_consensus.cc:2781] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:24:11.778704 14023 raft_consensus.cc:482] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:24:11.778723 14023 raft_consensus.cc:3037] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:11.779385 14023 raft_consensus.cc:504] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } }
I20260812 06:24:11.779500 14023 leader_election.cc:288] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [CANDIDATE]: Term 1 election: Requested vote from peers 943a8e1e04904bec90a115fd5e295607 (127.30.15.66:44265), 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249)
I20260812 06:24:11.779636 13644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4555d76adabd452cab51222e3399998d" candidate_uuid: "a693cc92257d49d89db1c2cb74763092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "943a8e1e04904bec90a115fd5e295607"
I20260812 06:24:11.779716 13644 raft_consensus.cc:3037] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:11.779693 13390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4555d76adabd452cab51222e3399998d" candidate_uuid: "a693cc92257d49d89db1c2cb74763092" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929137514e4b422a819412ff64fb8b4f"
I20260812 06:24:11.779754 13390 raft_consensus.cc:3037] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:11.780333 13390 raft_consensus.cc:2454] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a693cc92257d49d89db1c2cb74763092 in term 1.
I20260812 06:24:11.780361 13644 raft_consensus.cc:2454] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a693cc92257d49d89db1c2cb74763092 in term 1.
I20260812 06:24:11.780500 13773 leader_election.cc:302] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 929137514e4b422a819412ff64fb8b4f, a693cc92257d49d89db1c2cb74763092; no voters:
I20260812 06:24:11.780620 14023 raft_consensus.cc:2781] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:11.780673 14023 raft_consensus.cc:686] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [term 1 LEADER]: Becoming Leader. State: Replica: a693cc92257d49d89db1c2cb74763092, State: Running, Role: LEADER
I20260812 06:24:11.780711 14023 consensus_queue.cc:237] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } }
I20260812 06:24:11.781031 14063 tablet_replica.cc:439] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: TxnStatusTablet state changed. Reason: New leader a693cc92257d49d89db1c2cb74763092. Latest consensus state: current_term: 1 leader_uuid: "a693cc92257d49d89db1c2cb74763092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } }
I20260812 06:24:11.781150 14063 tablet_replica.cc:442] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:24:11.781292 13077 catalog_manager.cc:5495] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 reported cstate change: term changed from 0 to 1, leader changed from <none> to a693cc92257d49d89db1c2cb74763092 (127.30.15.67). New cstate: current_term: 1 leader_uuid: "a693cc92257d49d89db1c2cb74763092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } health_report { overall_health: UNKNOWN } } }
I20260812 06:24:11.781368 14093 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:24:11.781466 14093 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 06:24:11.787243 14007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.784587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43976 (local address 127.30.15.67:38923)
0812 06:24:11.784627 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.784629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.784674 (+ 45us) server_negotiation.cc:407] Connection header received
0812 06:24:11.784765 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.784766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.784781 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.784834 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:24:11.784968 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.785443 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.786530 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.786707 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.786750 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.786954 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:24:11.787038 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:24:11.787094 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.787163 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.787179 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:24:11.787308 14079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.784544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:38923 (local address 127.0.0.1:43976)
0812 06:24:11.784629 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:11.784640 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:11.784692 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:11.784842 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:11.784843 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:11.784845 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:24:11.784911 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.784913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.785512 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.785512 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.786449 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.786453 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.786771 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.786773 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.786849 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.786870 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:24:11.787101 (+ 231us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:24:11.787107 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.787160 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.787211 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 06:24:11.788221 13390 raft_consensus.cc:1261] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Refusing update from remote peer a693cc92257d49d89db1c2cb74763092: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:11.788317 13644 raft_consensus.cc:1261] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Refusing update from remote peer a693cc92257d49d89db1c2cb74763092: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:11.788446 14023 consensus_queue.cc:1035] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:11.788554 14063 consensus_queue.cc:1035] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:11.789100 14024 tablet_replica.cc:439] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f: TxnStatusTablet state changed. Reason: New leader a693cc92257d49d89db1c2cb74763092. Latest consensus state: current_term: 1 leader_uuid: "a693cc92257d49d89db1c2cb74763092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } }
I20260812 06:24:11.789187 14024 tablet_replica.cc:442] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:24:11.789276 14044 tablet_replica.cc:439] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607: TxnStatusTablet state changed. Reason: New leader a693cc92257d49d89db1c2cb74763092. Latest consensus state: current_term: 1 leader_uuid: "a693cc92257d49d89db1c2cb74763092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } }
I20260812 06:24:11.789351 14044 tablet_replica.cc:442] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:24:11.789747 14023 tablet_replica.cc:439] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a693cc92257d49d89db1c2cb74763092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } }
I20260812 06:24:11.789826 14023 tablet_replica.cc:442] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:24:11.790292 14037 mvcc.cc:205] Tried to move back new op lower bound from 7317568928922918912 to 7317568928894185472. Current Snapshot: MvccSnapshot[applied={T|T < 7317568928922918912}]
I20260812 06:24:11.790515 14044 tablet_replica.cc:439] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a693cc92257d49d89db1c2cb74763092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } }
I20260812 06:24:11.790584 14044 tablet_replica.cc:442] T 4555d76adabd452cab51222e3399998d P 943a8e1e04904bec90a115fd5e295607: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:24:11.790869 14063 tablet_replica.cc:439] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a693cc92257d49d89db1c2cb74763092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } }
I20260812 06:24:11.790938 14063 tablet_replica.cc:442] T 4555d76adabd452cab51222e3399998d P a693cc92257d49d89db1c2cb74763092: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:24:11.791605 14024 tablet_replica.cc:439] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a693cc92257d49d89db1c2cb74763092" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } } peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } }
I20260812 06:24:11.791689 14024 tablet_replica.cc:442] T 4555d76adabd452cab51222e3399998d P 929137514e4b422a819412ff64fb8b4f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:24:11.793706 14007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.791434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43982 (local address 127.30.15.67:38923)
0812 06:24:11.791740 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.791742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.791749 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:24:11.791766 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.791766 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.791786 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.791837 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:24:11.791986 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.792456 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.793137 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.793329 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.793379 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.793505 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:24:11.793537 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:24:11.793580 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.793632 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.793649 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288}
I20260812 06:24:11.798197 14007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.796134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:42989 (local address 127.30.15.67:38923)
0812 06:24:11.796161 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.796163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.796210 (+ 47us) server_negotiation.cc:407] Connection header received
0812 06:24:11.796264 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.796264 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.796272 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.796313 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:24:11.796431 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.796843 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.797621 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.797806 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.797856 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.797995 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:24:11.798022 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:24:11.798068 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.798117 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.798131 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 06:24:11.798255 14102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.795991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:38923 (local address 127.30.15.67:42989)
0812 06:24:11.796159 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:11.796169 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:11.796223 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:11.796313 (+ 90us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:11.796314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:11.796315 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:24:11.796379 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.796381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.796903 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.796904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.797554 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:11.797556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.797860 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.797861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:11.797920 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.797934 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:24:11.798069 (+ 135us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:24:11.798070 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:24:11.798107 (+ 37us) client_negotiation.cc:240] Negotiation successful
0812 06:24:11.798143 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":93,"threads_started":1}
I20260812 06:24:11.800360 13390 raft_consensus.cc:1261] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Refusing update from remote peer a693cc92257d49d89db1c2cb74763092: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:11.800486 13644 raft_consensus.cc:1261] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Refusing update from remote peer a693cc92257d49d89db1c2cb74763092: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:11.800575 14103 consensus_queue.cc:1035] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:11.800689 14023 consensus_queue.cc:1035] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [LEADER]: Connected to new peer: Peer: permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:11.812686 13077 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:11.812762 13077 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41398:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:11.814368 13077 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e: Sending DeleteTablet for 3 replicas of tablet fdd2821e0f4645f6b38a5f090b40ab67
I20260812 06:24:11.814608 13613 tablet_service.cc:1514] Processing DeleteTablet for tablet fdd2821e0f4645f6b38a5f090b40ab67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:11 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:50854
I20260812 06:24:11.814656 13352 tablet_service.cc:1514] Processing DeleteTablet for tablet fdd2821e0f4645f6b38a5f090b40ab67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:11 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:47294
I20260812 06:24:11.814669 13858 tablet_service.cc:1514] Processing DeleteTablet for tablet fdd2821e0f4645f6b38a5f090b40ab67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:11 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:43964
I20260812 06:24:11.814694 14052 tablet_replica.cc:330] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607: stopping tablet replica
I20260812 06:24:11.814738 14052 raft_consensus.cc:2229] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:11.814749 14050 tablet_replica.cc:330] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f: stopping tablet replica
I20260812 06:24:11.814769 14052 raft_consensus.cc:2258] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:11.814798 14050 raft_consensus.cc:2229] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:11.814826 14050 raft_consensus.cc:2258] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:11.814889 14053 tablet_replica.cc:330] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092: stopping tablet replica
I20260812 06:24:11.814944 14053 raft_consensus.cc:2229] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:24:11.815061 14053 raft_consensus.cc:2258] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:11.815178 14052 ts_tablet_manager.cc:1905] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:11.815476 14053 ts_tablet_manager.cc:1905] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:11.816612 14052 ts_tablet_manager.cc:1918] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:24:11.816659 14052 log.cc:1196] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/fdd2821e0f4645f6b38a5f090b40ab67
I20260812 06:24:11.816865 14052 ts_tablet_manager.cc:1939] T fdd2821e0f4645f6b38a5f090b40ab67 P 943a8e1e04904bec90a115fd5e295607: Deleting consensus metadata
I20260812 06:24:11.816934 14053 ts_tablet_manager.cc:1918] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:24:11.817003 14053 log.cc:1196] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/fdd2821e0f4645f6b38a5f090b40ab67
I20260812 06:24:11.817143 13053 catalog_manager.cc:4841] TS 943a8e1e04904bec90a115fd5e295607 (127.30.15.66:44265): tablet fdd2821e0f4645f6b38a5f090b40ab67 (table test-table [id=2e8c02c628fb420ca38176ffeea244f9]) successfully deleted
I20260812 06:24:11.817214 14053 ts_tablet_manager.cc:1939] T fdd2821e0f4645f6b38a5f090b40ab67 P a693cc92257d49d89db1c2cb74763092: Deleting consensus metadata
I20260812 06:24:11.817469 13055 catalog_manager.cc:4841] TS a693cc92257d49d89db1c2cb74763092 (127.30.15.67:38923): tablet fdd2821e0f4645f6b38a5f090b40ab67 (table test-table [id=2e8c02c628fb420ca38176ffeea244f9]) successfully deleted
I20260812 06:24:11.818605 14050 ts_tablet_manager.cc:1905] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:11.819741 14050 ts_tablet_manager.cc:1918] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:24:11.819792 14050 log.cc:1196] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/wal/wals/fdd2821e0f4645f6b38a5f090b40ab67
I20260812 06:24:11.819954 14050 ts_tablet_manager.cc:1939] T fdd2821e0f4645f6b38a5f090b40ab67 P 929137514e4b422a819412ff64fb8b4f: Deleting consensus metadata
I20260812 06:24:11.820242 13055 catalog_manager.cc:4841] TS 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249): tablet fdd2821e0f4645f6b38a5f090b40ab67 (table test-table [id=2e8c02c628fb420ca38176ffeea244f9]) successfully deleted
Aug 12 06:24:11 dist-test-slave-gjrz krb5kdc[12986](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515851, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 06:24:11 dist-test-slave-gjrz krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:11 dist-test-slave-gjrz krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:24:11.847659 14082 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:11.842437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41414 (local address 127.30.15.126:39035)
0812 06:24:11.842497 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.842499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.842583 (+ 84us) server_negotiation.cc:407] Connection header received
0812 06:24:11.842627 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.842628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.842638 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.842699 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:11.843189 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.844014 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.844712 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.845023 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.845092 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.847601 (+ 2509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41414: BlockingRecv error: recv got EOF from 127.0.0.1:41414 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 06:24:11 dist-test-slave-gjrz krb5kdc[12986](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515851, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM
I20260812 06:24:11.854674 14082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:11.848418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41420 (local address 127.30.15.126:39035)
0812 06:24:11.848449 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:11.848451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:11.848523 (+ 72us) server_negotiation.cc:407] Connection header received
0812 06:24:11.848597 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:11.848597 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:11.848607 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:11.848653 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:11.849060 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.849626 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.850349 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:11.850551 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:11.850603 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:11.852470 (+ 1867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:11.852471 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:11.852471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:11.852478 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:11.853709 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:11.853994 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:11.853995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:11.853995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:11.854050 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:11.854209 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:11.854210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:11.854210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:11.854314 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:11.854402 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:11.854505 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 06:24:11.854589 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:24:11.856235 13077 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41420:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:24:11.856400 13077 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:24:11.857668 13352 tablet_service.cc:1467] Processing CreateTablet for tablet 655966268f2f42c499f8db560cc2f4e0 (DEFAULT_TABLE table=test-table [id=88e232f9abb749629ed83b8c7a081269]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:11.857693 13613 tablet_service.cc:1467] Processing CreateTablet for tablet 655966268f2f42c499f8db560cc2f4e0 (DEFAULT_TABLE table=test-table [id=88e232f9abb749629ed83b8c7a081269]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:11.857713 13858 tablet_service.cc:1467] Processing CreateTablet for tablet 655966268f2f42c499f8db560cc2f4e0 (DEFAULT_TABLE table=test-table [id=88e232f9abb749629ed83b8c7a081269]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:11.857782 13352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 655966268f2f42c499f8db560cc2f4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:11.857810 13858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 655966268f2f42c499f8db560cc2f4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:11.857815 13613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 655966268f2f42c499f8db560cc2f4e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:11.859020 14011 tablet_bootstrap.cc:492] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f: Bootstrap starting.
I20260812 06:24:11.859117 14008 tablet_bootstrap.cc:492] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092: Bootstrap starting.
I20260812 06:24:11.859368 14011 tablet_bootstrap.cc:654] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:11.859548 14008 tablet_bootstrap.cc:654] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:11.859871 14009 tablet_bootstrap.cc:492] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607: Bootstrap starting.
I20260812 06:24:11.859970 14011 tablet_bootstrap.cc:492] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f: No bootstrap required, opened a new log
I20260812 06:24:11.860009 14011 ts_tablet_manager.cc:1397] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:24:11.860133 14011 raft_consensus.cc:348] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.860172 14009 tablet_bootstrap.cc:654] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:11.860178 14011 raft_consensus.cc:374] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:11.860214 14011 raft_consensus.cc:729] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929137514e4b422a819412ff64fb8b4f, State: Initialized, Role: FOLLOWER
I20260812 06:24:11.860251 14011 consensus_queue.cc:260] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.860324 14011 ts_tablet_manager.cc:1428] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:11.860662 14008 tablet_bootstrap.cc:492] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092: No bootstrap required, opened a new log
I20260812 06:24:11.860720 14008 ts_tablet_manager.cc:1397] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:24:11.860867 14008 raft_consensus.cc:348] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.860939 14008 raft_consensus.cc:374] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:11.860960 14008 raft_consensus.cc:729] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a693cc92257d49d89db1c2cb74763092, State: Initialized, Role: FOLLOWER
I20260812 06:24:11.861011 14008 consensus_queue.cc:260] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.861105 14008 ts_tablet_manager.cc:1428] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:11.861423 14009 tablet_bootstrap.cc:492] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607: No bootstrap required, opened a new log
I20260812 06:24:11.861490 14009 ts_tablet_manager.cc:1397] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:24:11.861589 14009 raft_consensus.cc:348] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.861656 14009 raft_consensus.cc:374] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:11.861682 14009 raft_consensus.cc:729] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943a8e1e04904bec90a115fd5e295607, State: Initialized, Role: FOLLOWER
I20260812 06:24:11.861726 14009 consensus_queue.cc:260] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.861820 14009 ts_tablet_manager.cc:1428] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:11.971191 14044 raft_consensus.cc:482] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:24:11.971302 14044 raft_consensus.cc:504] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.971457 14044 leader_election.cc:288] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249), a693cc92257d49d89db1c2cb74763092 (127.30.15.67:38923)
I20260812 06:24:11.971695 13892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "655966268f2f42c499f8db560cc2f4e0" candidate_uuid: "943a8e1e04904bec90a115fd5e295607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a693cc92257d49d89db1c2cb74763092" is_pre_election: true
I20260812 06:24:11.971695 13390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "655966268f2f42c499f8db560cc2f4e0" candidate_uuid: "943a8e1e04904bec90a115fd5e295607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929137514e4b422a819412ff64fb8b4f" is_pre_election: true
I20260812 06:24:11.971801 13892 raft_consensus.cc:2454] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 943a8e1e04904bec90a115fd5e295607 in term 0.
I20260812 06:24:11.971801 13390 raft_consensus.cc:2454] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 943a8e1e04904bec90a115fd5e295607 in term 0.
I20260812 06:24:11.971940 13534 leader_election.cc:302] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 943a8e1e04904bec90a115fd5e295607, a693cc92257d49d89db1c2cb74763092; no voters:
I20260812 06:24:11.972078 14044 raft_consensus.cc:2781] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:24:11.972153 14044 raft_consensus.cc:482] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:24:11.972183 14044 raft_consensus.cc:3037] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:11.973222 14044 raft_consensus.cc:504] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.973368 14044 leader_election.cc:288] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [CANDIDATE]: Term 1 election: Requested vote from peers 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249), a693cc92257d49d89db1c2cb74763092 (127.30.15.67:38923)
I20260812 06:24:11.973616 13892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "655966268f2f42c499f8db560cc2f4e0" candidate_uuid: "943a8e1e04904bec90a115fd5e295607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a693cc92257d49d89db1c2cb74763092"
I20260812 06:24:11.973596 13390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "655966268f2f42c499f8db560cc2f4e0" candidate_uuid: "943a8e1e04904bec90a115fd5e295607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929137514e4b422a819412ff64fb8b4f"
I20260812 06:24:11.973703 13892 raft_consensus.cc:3037] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:11.973703 13390 raft_consensus.cc:3037] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:11.974354 13892 raft_consensus.cc:2454] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 943a8e1e04904bec90a115fd5e295607 in term 1.
I20260812 06:24:11.974512 13390 raft_consensus.cc:2454] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 943a8e1e04904bec90a115fd5e295607 in term 1.
I20260812 06:24:11.974516 13534 leader_election.cc:302] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 943a8e1e04904bec90a115fd5e295607, a693cc92257d49d89db1c2cb74763092; no voters:
I20260812 06:24:11.974661 14044 raft_consensus.cc:2781] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:11.974728 14044 raft_consensus.cc:686] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 1 LEADER]: Becoming Leader. State: Replica: 943a8e1e04904bec90a115fd5e295607, State: Running, Role: LEADER
I20260812 06:24:11.974783 14044 consensus_queue.cc:237] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:11.975421 13077 catalog_manager.cc:5495] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 reported cstate change: term changed from 0 to 1, leader changed from <none> to 943a8e1e04904bec90a115fd5e295607 (127.30.15.66). New cstate: current_term: 1 leader_uuid: "943a8e1e04904bec90a115fd5e295607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } health_report { overall_health: UNKNOWN } } }
I20260812 06:24:12.007040 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:12.004946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50876 (local address 127.30.15.66:44265)
0812 06:24:12.005003 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:12.005005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:12.005013 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:12.005035 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:12.005036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:12.005055 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:12.005103 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:24:12.005213 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:12.005691 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:12.006427 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:12.006635 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:12.006690 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:12.006821 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:24:12.006859 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:24:12.006900 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:12.006954 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 06:24:12.006976 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:24:12.007799 13892 raft_consensus.cc:1261] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Refusing update from remote peer 943a8e1e04904bec90a115fd5e295607: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:12.007797 13390 raft_consensus.cc:1261] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Refusing update from remote peer 943a8e1e04904bec90a115fd5e295607: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:12.007997 14033 consensus_queue.cc:1035] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:12.008098 14044 consensus_queue.cc:1035] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:12.010766 13073 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:12.010855 13073 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:12.011432 13073 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e: Sending DeleteTablet for 3 replicas of tablet 655966268f2f42c499f8db560cc2f4e0
I20260812 06:24:12.011664 13613 tablet_service.cc:1514] Processing DeleteTablet for tablet 655966268f2f42c499f8db560cc2f4e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:12 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:50854
I20260812 06:24:12.011665 13858 tablet_service.cc:1514] Processing DeleteTablet for tablet 655966268f2f42c499f8db560cc2f4e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:12 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:43964
I20260812 06:24:12.011755 14053 tablet_replica.cc:330] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092: stopping tablet replica
I20260812 06:24:12.011807 14053 raft_consensus.cc:2229] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:12.011847 14053 raft_consensus.cc:2258] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:12.012043 13352 tablet_service.cc:1514] Processing DeleteTablet for tablet 655966268f2f42c499f8db560cc2f4e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:12 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:47294
I20260812 06:24:12.012131 14050 tablet_replica.cc:330] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f: stopping tablet replica
I20260812 06:24:12.012140 14052 tablet_replica.cc:330] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607: stopping tablet replica
I20260812 06:24:12.012188 14050 raft_consensus.cc:2229] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:12.012192 14052 raft_consensus.cc:2229] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:24:12.012230 14050 raft_consensus.cc:2258] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:12.012243 14052 raft_consensus.cc:2258] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:12.012523 14052 ts_tablet_manager.cc:1905] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:12.012629 14050 ts_tablet_manager.cc:1905] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:12.013684 13073 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41420:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 06:24:12.013861 14052 ts_tablet_manager.cc:1918] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260812 06:24:12.013867 13073 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:24:12.013911 14052 log.cc:1196] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/655966268f2f42c499f8db560cc2f4e0
I20260812 06:24:12.014015 14050 ts_tablet_manager.cc:1918] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:24:12.014063 14050 log.cc:1196] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-0/wal/wals/655966268f2f42c499f8db560cc2f4e0
I20260812 06:24:12.014120 14052 ts_tablet_manager.cc:1939] T 655966268f2f42c499f8db560cc2f4e0 P 943a8e1e04904bec90a115fd5e295607: Deleting consensus metadata
I20260812 06:24:12.014264 14050 ts_tablet_manager.cc:1939] T 655966268f2f42c499f8db560cc2f4e0 P 929137514e4b422a819412ff64fb8b4f: Deleting consensus metadata
I20260812 06:24:12.014328 14053 ts_tablet_manager.cc:1905] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:12.014577 13055 catalog_manager.cc:4841] TS 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249): tablet 655966268f2f42c499f8db560cc2f4e0 (table test-table [id=88e232f9abb749629ed83b8c7a081269]) successfully deleted
I20260812 06:24:12.015412 13053 catalog_manager.cc:4841] TS 943a8e1e04904bec90a115fd5e295607 (127.30.15.66:44265): tablet 655966268f2f42c499f8db560cc2f4e0 (table test-table [id=88e232f9abb749629ed83b8c7a081269]) successfully deleted
I20260812 06:24:12.015655 14053 ts_tablet_manager.cc:1918] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:24:12.015712 14053 log.cc:1196] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/655966268f2f42c499f8db560cc2f4e0
I20260812 06:24:12.015872 14053 ts_tablet_manager.cc:1939] T 655966268f2f42c499f8db560cc2f4e0 P a693cc92257d49d89db1c2cb74763092: Deleting consensus metadata
I20260812 06:24:12.016209 13055 catalog_manager.cc:4841] TS a693cc92257d49d89db1c2cb74763092 (127.30.15.67:38923): tablet 655966268f2f42c499f8db560cc2f4e0 (table test-table [id=88e232f9abb749629ed83b8c7a081269]) successfully deleted
I20260812 06:24:12.016721 13858 tablet_service.cc:1467] Processing CreateTablet for tablet 17d6c374bc7f418691b32640295ed964 (DEFAULT_TABLE table=test-table [id=475cb20b4b58484c9ce216a62e238c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:12.016825 13858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d6c374bc7f418691b32640295ed964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:12.017720 14008 tablet_bootstrap.cc:492] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092: Bootstrap starting.
I20260812 06:24:12.017750 13352 tablet_service.cc:1467] Processing CreateTablet for tablet 17d6c374bc7f418691b32640295ed964 (DEFAULT_TABLE table=test-table [id=475cb20b4b58484c9ce216a62e238c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:12.017856 13352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d6c374bc7f418691b32640295ed964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:12.018023 14008 tablet_bootstrap.cc:654] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:12.018558 14008 tablet_bootstrap.cc:492] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092: No bootstrap required, opened a new log
I20260812 06:24:12.018608 14008 ts_tablet_manager.cc:1397] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:24:12.018712 14008 raft_consensus.cc:348] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:12.018800 14008 raft_consensus.cc:374] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:12.018818 14008 raft_consensus.cc:729] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a693cc92257d49d89db1c2cb74763092, State: Initialized, Role: FOLLOWER
I20260812 06:24:12.018857 14008 consensus_queue.cc:260] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:12.018934 14011 tablet_bootstrap.cc:492] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f: Bootstrap starting.
I20260812 06:24:12.018952 14008 ts_tablet_manager.cc:1428] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:12.019392 14011 tablet_bootstrap.cc:654] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:12.019775 13613 tablet_service.cc:1467] Processing CreateTablet for tablet 17d6c374bc7f418691b32640295ed964 (DEFAULT_TABLE table=test-table [id=475cb20b4b58484c9ce216a62e238c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:12.019877 13613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17d6c374bc7f418691b32640295ed964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:12.020066 14011 tablet_bootstrap.cc:492] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f: No bootstrap required, opened a new log
I20260812 06:24:12.020103 14011 ts_tablet_manager.cc:1397] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:24:12.020248 14011 raft_consensus.cc:348] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:12.020301 14011 raft_consensus.cc:374] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:12.020314 14011 raft_consensus.cc:729] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929137514e4b422a819412ff64fb8b4f, State: Initialized, Role: FOLLOWER
I20260812 06:24:12.020345 14011 consensus_queue.cc:260] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:12.020434 14011 ts_tablet_manager.cc:1428] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:12.020905 14009 tablet_bootstrap.cc:492] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607: Bootstrap starting.
I20260812 06:24:12.021174 14009 tablet_bootstrap.cc:654] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:12.021665 14009 tablet_bootstrap.cc:492] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607: No bootstrap required, opened a new log
I20260812 06:24:12.021713 14009 ts_tablet_manager.cc:1397] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:12.021795 14009 raft_consensus.cc:348] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:12.021835 14009 raft_consensus.cc:374] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:12.021847 14009 raft_consensus.cc:729] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 943a8e1e04904bec90a115fd5e295607, State: Initialized, Role: FOLLOWER
I20260812 06:24:12.021893 14009 consensus_queue.cc:260] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:12.022001 14009 ts_tablet_manager.cc:1428] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:12.073171 14033 raft_consensus.cc:482] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:24:12.073278 14033 raft_consensus.cc:504] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:12.073436 14033 leader_election.cc:288] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249), a693cc92257d49d89db1c2cb74763092 (127.30.15.67:38923)
I20260812 06:24:12.073658 13892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6c374bc7f418691b32640295ed964" candidate_uuid: "943a8e1e04904bec90a115fd5e295607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a693cc92257d49d89db1c2cb74763092" is_pre_election: true
I20260812 06:24:12.073639 13390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6c374bc7f418691b32640295ed964" candidate_uuid: "943a8e1e04904bec90a115fd5e295607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929137514e4b422a819412ff64fb8b4f" is_pre_election: true
I20260812 06:24:12.073742 13390 raft_consensus.cc:2454] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 943a8e1e04904bec90a115fd5e295607 in term 0.
I20260812 06:24:12.073745 13892 raft_consensus.cc:2454] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 943a8e1e04904bec90a115fd5e295607 in term 0.
I20260812 06:24:12.073908 13534 leader_election.cc:302] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 929137514e4b422a819412ff64fb8b4f, 943a8e1e04904bec90a115fd5e295607; no voters:
I20260812 06:24:12.074011 14033 raft_consensus.cc:2781] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:24:12.074061 14033 raft_consensus.cc:482] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:24:12.074086 14033 raft_consensus.cc:3037] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:12.074841 14033 raft_consensus.cc:504] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:12.074955 14033 leader_election.cc:288] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [CANDIDATE]: Term 1 election: Requested vote from peers 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249), a693cc92257d49d89db1c2cb74763092 (127.30.15.67:38923)
I20260812 06:24:12.075105 13390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6c374bc7f418691b32640295ed964" candidate_uuid: "943a8e1e04904bec90a115fd5e295607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929137514e4b422a819412ff64fb8b4f"
I20260812 06:24:12.075172 13390 raft_consensus.cc:3037] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:12.075132 13892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17d6c374bc7f418691b32640295ed964" candidate_uuid: "943a8e1e04904bec90a115fd5e295607" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a693cc92257d49d89db1c2cb74763092"
I20260812 06:24:12.075202 13892 raft_consensus.cc:3037] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:12.075778 13390 raft_consensus.cc:2454] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 943a8e1e04904bec90a115fd5e295607 in term 1.
I20260812 06:24:12.075856 13892 raft_consensus.cc:2454] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 943a8e1e04904bec90a115fd5e295607 in term 1.
I20260812 06:24:12.075943 13534 leader_election.cc:302] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 929137514e4b422a819412ff64fb8b4f, 943a8e1e04904bec90a115fd5e295607; no voters:
I20260812 06:24:12.076030 14033 raft_consensus.cc:2781] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:12.076087 14033 raft_consensus.cc:686] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 1 LEADER]: Becoming Leader. State: Replica: 943a8e1e04904bec90a115fd5e295607, State: Running, Role: LEADER
I20260812 06:24:12.076138 14033 consensus_queue.cc:237] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } }
I20260812 06:24:12.076704 13073 catalog_manager.cc:5495] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 reported cstate change: term changed from 0 to 1, leader changed from <none> to 943a8e1e04904bec90a115fd5e295607 (127.30.15.66). New cstate: current_term: 1 leader_uuid: "943a8e1e04904bec90a115fd5e295607" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "943a8e1e04904bec90a115fd5e295607" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 44265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 } health_report { overall_health: UNKNOWN } } }
I20260812 06:24:12.095257 14007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:12.093047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:51351 (local address 127.30.15.67:38923)
0812 06:24:12.093121 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:12.093123 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:12.093181 (+ 58us) server_negotiation.cc:407] Connection header received
0812 06:24:12.093246 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:12.093246 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:12.093258 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:12.093298 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:24:12.093412 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:12.093885 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:12.094621 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:12.094814 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:12.094868 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:12.095037 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:24:12.095072 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:24:12.095114 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:12.095168 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 06:24:12.095189 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 06:24:12.095309 14164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:12.092961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:38923 (local address 127.30.15.66:51351)
0812 06:24:12.093118 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:12.093130 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:12.093189 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:12.093312 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:12.093313 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:12.093314 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:24:12.093364 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:12.093365 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:12.093957 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:12.093958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:12.094547 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:12.094549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:12.094877 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:12.094878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:12.094941 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:12.094956 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:24:12.095124 (+ 168us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:24:12.095126 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:24:12.095167 (+ 41us) client_negotiation.cc:240] Negotiation successful
0812 06:24:12.095220 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":75,"threads_started":1}
I20260812 06:24:12.097083 13892 raft_consensus.cc:1261] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Refusing update from remote peer 943a8e1e04904bec90a115fd5e295607: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:12.097121 13390 raft_consensus.cc:1261] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Refusing update from remote peer 943a8e1e04904bec90a115fd5e295607: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:12.097280 14033 consensus_queue.cc:1035] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "929137514e4b422a819412ff64fb8b4f" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 37249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:12.097385 14044 consensus_queue.cc:1035] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a693cc92257d49d89db1c2cb74763092" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 38923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:12.103490 14000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:12.101541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:56155 (local address 127.30.15.66:44265)
0812 06:24:12.101581 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:12.101583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:12.101623 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:24:12.101683 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:12.101684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:12.101695 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:12.101741 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:24:12.101846 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:12.102304 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:12.102955 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:12.103156 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:12.103206 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:12.103322 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:24:12.103356 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:24:12.103388 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:12.103427 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 06:24:12.103443 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:24:12.103518 14102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:12.101495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:44265 (local address 127.30.15.67:56155)
0812 06:24:12.101577 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:12.101589 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:12.101637 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:12.101747 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:12.101748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:12.101749 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 06:24:12.101791 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:12.101793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:12.102357 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:12.102358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:12.102896 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:12.102897 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:12.103208 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:12.103209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:12.103246 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:12.103250 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 06:24:12.103395 (+ 145us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 06:24:12.103396 (+ 1us) client_negotiation.cc:769] Sending connection context
0812 06:24:12.103425 (+ 29us) client_negotiation.cc:240] Negotiation successful
0812 06:24:12.103463 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 06:24:12.110138 13081 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:12.110229 13081 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:12.110765 13081 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8ee3defd9f5c425892fd862f94a0242e: Sending DeleteTablet for 3 replicas of tablet 17d6c374bc7f418691b32640295ed964
I20260812 06:24:12.110987 13613 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d6c374bc7f418691b32640295ed964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:12 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:50854
I20260812 06:24:12.110994 13352 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d6c374bc7f418691b32640295ed964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:12 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:47294
I20260812 06:24:12.111028 13858 tablet_service.cc:1514] Processing DeleteTablet for tablet 17d6c374bc7f418691b32640295ed964 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:12 UTC) from {username='oryx', principal='oryx/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:43964
I20260812 06:24:12.111119 14050 tablet_replica.cc:330] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f: stopping tablet replica
I20260812 06:24:12.111114 14053 tablet_replica.cc:330] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092: stopping tablet replica
I20260812 06:24:12.111135 14052 tablet_replica.cc:330] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607: stopping tablet replica
I20260812 06:24:12.111177 14053 raft_consensus.cc:2229] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:12.111177 14050 raft_consensus.cc:2229] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:12.111183 14052 raft_consensus.cc:2229] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:24:12.111217 14050 raft_consensus.cc:2258] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:12.111219 14053 raft_consensus.cc:2258] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:12.111238 14052 raft_consensus.cc:2258] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:12.111531 14050 ts_tablet_manager.cc:1905] T 17d6c374bc7f418691b32640295ed964 P 929137514e4b422a819412ff64fb8b4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:12.111563 14052 ts_tablet_manager.cc:1905] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:12.112645 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 13220
I20260812 06:24:12.123420 14053 ts_tablet_manager.cc:1905] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:12.124747 14053 ts_tablet_manager.cc:1918] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:24:12.124792 14053 log.cc:1196] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/17d6c374bc7f418691b32640295ed964
I20260812 06:24:12.124951 14053 ts_tablet_manager.cc:1939] T 17d6c374bc7f418691b32640295ed964 P a693cc92257d49d89db1c2cb74763092: Deleting consensus metadata
I20260812 06:24:12.126139 14052 ts_tablet_manager.cc:1918] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 06:24:12.126222 14052 log.cc:1196] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/17d6c374bc7f418691b32640295ed964
I20260812 06:24:12.126500 14052 ts_tablet_manager.cc:1939] T 17d6c374bc7f418691b32640295ed964 P 943a8e1e04904bec90a115fd5e295607: Deleting consensus metadata
I20260812 06:24:12.126880 13053 catalog_manager.cc:4841] TS 943a8e1e04904bec90a115fd5e295607 (127.30.15.66:44265): tablet 17d6c374bc7f418691b32640295ed964 (table test-table [id=475cb20b4b58484c9ce216a62e238c7f]) successfully deleted
I20260812 06:24:12.127315 13055 catalog_manager.cc:4841] TS a693cc92257d49d89db1c2cb74763092 (127.30.15.67:38923): tablet 17d6c374bc7f418691b32640295ed964 (table test-table [id=475cb20b4b58484c9ce216a62e238c7f]) successfully deleted
W20260812 06:24:12.131708 13055 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:37249 (error 108)
I20260812 06:24:12.131968 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 13500
I20260812 06:24:12.132325 14177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:12.132132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:37249 (local address 127.0.0.1:47306)
0812 06:24:12.132247 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:12.132286 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:37249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":59,"threads_started":1}
W20260812 06:24:12.132398 13055 catalog_manager.cc:4584] TS 929137514e4b422a819412ff64fb8b4f (127.30.15.65:37249): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 17d6c374bc7f418691b32640295ed964: Network error: Client connection negotiation failed: client connection to 127.30.15.65:37249: connect: Connection refused (error 111)
I20260812 06:24:12.146739 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 13747
I20260812 06:24:12.159140 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 13016
2026-08-12T06:24:12Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2971 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:24:12 dist-test-slave-gjrz krb5kdc[14181](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:24:12 dist-test-slave-gjrz krb5kdc[14181](info): set up 2 sockets
Aug 12 06:24:12 dist-test-slave-gjrz krb5kdc[14181](info): commencing operation
krb5kdc: starting...
W20260812 06:24:13.362428 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:24:13 dist-test-slave-gjrz krb5kdc[14181](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:24:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:24:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:24:13.472415 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:39105
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:39217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:39105
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:13.552829 14204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:13.553038 14204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:13.553068 14204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:13.554165 14204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:24:13.554204 14204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:13.554224 14204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:13.554239 14204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:24:13.554253 14204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:24:13.555691 14204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:39105
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:39105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:13.555923 14204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:13.556123 14204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:13.560609 14212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:13.560619 14213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:13.560672 14204 server_base.cc:1034] running on GCE node
W20260812 06:24:13.560621 14218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:13.561131 14204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:13.561374 14204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:13.562507 14204 hybrid_clock.cc:648] HybridClock initialized: now 1786515853562491 us; error 30 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T06:24:13Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1395 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:24:13 dist-test-slave-gjrz krb5kdc[14229](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:24:13 dist-test-slave-gjrz krb5kdc[14229](info): set up 2 sockets
Aug 12 06:24:13 dist-test-slave-gjrz krb5kdc[14229](info): commencing operation
krb5kdc: starting...
W20260812 06:24:14.747509 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:24:14 dist-test-slave-gjrz krb5kdc[14229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:24:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:24:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:24:14.858204 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:37937
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:37937
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:14.937755 14252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:14.937945 14252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:14.937975 14252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:14.939067 14252 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:24:14.939105 14252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:14.939124 14252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:14.939141 14252 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:24:14.939155 14252 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:24:14.940567 14252 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:37937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:37937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:14.940788 14252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:14.940995 14252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:24:14.945652 14252 server_base.cc:1034] running on GCE node
W20260812 06:24:14.945659 14261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:14.945627 14263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:14.945633 14265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:14.946108 14252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:14.946378 14252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:14.947511 14252 hybrid_clock.cc:648] HybridClock initialized: now 1786515854947492 us; error 33 us; skew 500 ppm
Aug 12 06:24:14 dist-test-slave-gjrz krb5kdc[14229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515854, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:14.953413 14252 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:24:14.953824 14252 webserver.cc:460] Webserver started at http://127.30.15.126:40183/ using document root <none> and password file <none>
I20260812 06:24:14.954067 14252 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:14.954115 14252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:14.954236 14252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:14.955186 14252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "e1c18aaa56274e36a647bd5ec5871269"
format_stamp: "Formatted at 2026-08-12 06:24:14 on dist-test-slave-gjrz"
server_key: "a00e62f739fba814ebb75996b08bfcef"
server_key_iv: "f40f6458c22d511c6b3714ce6405cfa9"
server_key_version: "encryptionkey@0"
I20260812 06:24:14.955549 14252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "e1c18aaa56274e36a647bd5ec5871269"
format_stamp: "Formatted at 2026-08-12 06:24:14 on dist-test-slave-gjrz"
server_key: "a00e62f739fba814ebb75996b08bfcef"
server_key_iv: "f40f6458c22d511c6b3714ce6405cfa9"
server_key_version: "encryptionkey@0"
I20260812 06:24:14.956717 14252 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:14.957343 14281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:14.957489 14252 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:14.957571 14252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "e1c18aaa56274e36a647bd5ec5871269"
format_stamp: "Formatted at 2026-08-12 06:24:14 on dist-test-slave-gjrz"
server_key: "a00e62f739fba814ebb75996b08bfcef"
server_key_iv: "f40f6458c22d511c6b3714ce6405cfa9"
server_key_version: "encryptionkey@0"
I20260812 06:24:14.957629 14252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:14.968179 14252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:14.970053 14252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:14.970175 14252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:14.974031 14252 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:37937
I20260812 06:24:14.974061 14376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:37937 every 8 connection(s)
I20260812 06:24:14.974346 14252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:24:14.975121 14377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:14.977149 14377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269: Bootstrap starting.
I20260812 06:24:14.977649 14377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:14.977874 14377 log.cc:824] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:14.978464 14377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269: No bootstrap required, opened a new log
I20260812 06:24:14.979964 14377 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c18aaa56274e36a647bd5ec5871269" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37937 } }
I20260812 06:24:14.980096 14377 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:14.980118 14377 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c18aaa56274e36a647bd5ec5871269, State: Initialized, Role: FOLLOWER
I20260812 06:24:14.980213 14377 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c18aaa56274e36a647bd5ec5871269" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37937 } }
I20260812 06:24:14.980260 14377 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:24:14.980283 14377 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:24:14.980310 14377 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:14.980757 14377 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c18aaa56274e36a647bd5ec5871269" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37937 } }
I20260812 06:24:14.980839 14377 leader_election.cc:302] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1c18aaa56274e36a647bd5ec5871269; no voters:
I20260812 06:24:14.980948 14377 leader_election.cc:288] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:24:14.981019 14380 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:14.981189 14377 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:24:14.981202 14380 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 1 LEADER]: Becoming Leader. State: Replica: e1c18aaa56274e36a647bd5ec5871269, State: Running, Role: LEADER
I20260812 06:24:14.981349 14380 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c18aaa56274e36a647bd5ec5871269" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37937 } }
I20260812 06:24:14.981917 14382 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1c18aaa56274e36a647bd5ec5871269" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c18aaa56274e36a647bd5ec5871269" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37937 } } }
I20260812 06:24:14.981979 14383 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1c18aaa56274e36a647bd5ec5871269. Latest consensus state: current_term: 1 leader_uuid: "e1c18aaa56274e36a647bd5ec5871269" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c18aaa56274e36a647bd5ec5871269" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37937 } } }
I20260812 06:24:14.982052 14383 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:14.982004 14382 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:14.982235 14396 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:24:14.982461 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 14252
I20260812 06:24:14.982580 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:24:14.982769 14396 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:24:14.982793 30781 external_mini_cluster.cc:1428] Setting key 8a2448dd13d1823ec19d73bc9aa1d6c5
I20260812 06:24:14.984520 14396 catalog_manager.cc:1347] Generated new cluster ID: 103377c1a5054e64a7546e57c717a377
I20260812 06:24:14.984565 14396 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:24:14 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:24:14.993839 14413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:14.983248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33104 (local address 127.30.15.126:37937)
0812 06:24:14.983723 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:14.983732 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:14.983758 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:24:14.983863 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:14.983870 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:14.983934 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:14.984067 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:14.984803 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:14.986194 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:14.987253 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:14.987830 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:14.987923 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:14.990515 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:14.990519 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:14.990520 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:14.990532 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:14.992365 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:14.992717 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:14.992720 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:14.992720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:14.992824 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:14.992992 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:14.992992 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:14.992993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:14.993274 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:14.993426 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:14.993491 (+ 65us) server_negotiation.cc:299] Negotiation successful
0812 06:24:14.993620 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":433,"thread_start_us":70,"threads_started":1}
I20260812 06:24:15.005498 14396 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:24:15.005995 14396 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:24:15.008392 14396 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269: Generated new TSK 0
I20260812 06:24:15.008543 14396 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:24:15.036000 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37937
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:15.115343 14418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:15.115530 14418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:15.115563 14418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:15.116691 14418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:15.116731 14418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:15.116765 14418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:24:15.118155 14418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:15.118374 14418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:15.118571 14418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:15.123210 14435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:15.123208 14432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:15.123302 14418 server_base.cc:1034] running on GCE node
W20260812 06:24:15.123301 14431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:15.123677 14418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:15.123903 14418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:15.125036 14418 hybrid_clock.cc:648] HybridClock initialized: now 1786515855125023 us; error 26 us; skew 500 ppm
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515855, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:15.127334 14418 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:24:15.127724 14418 webserver.cc:460] Webserver started at http://127.30.15.65:34137/ using document root <none> and password file <none>
I20260812 06:24:15.127910 14418 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:15.127955 14418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:15.128077 14418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:15.129016 14418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "5880110cdbdf490d9835f21ee92fd963"
format_stamp: "Formatted at 2026-08-12 06:24:15 on dist-test-slave-gjrz"
server_key: "b7c46bb1d1fed5c5f92715ae7c29df2b"
server_key_iv: "cb63437221f7f496e3f5680505ad3289"
server_key_version: "encryptionkey@0"
I20260812 06:24:15.129329 14418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "5880110cdbdf490d9835f21ee92fd963"
format_stamp: "Formatted at 2026-08-12 06:24:15 on dist-test-slave-gjrz"
server_key: "b7c46bb1d1fed5c5f92715ae7c29df2b"
server_key_iv: "cb63437221f7f496e3f5680505ad3289"
server_key_version: "encryptionkey@0"
I20260812 06:24:15.130595 14418 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:24:15.131199 14448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.131348 14418 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.131428 14418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "5880110cdbdf490d9835f21ee92fd963"
format_stamp: "Formatted at 2026-08-12 06:24:15 on dist-test-slave-gjrz"
server_key: "b7c46bb1d1fed5c5f92715ae7c29df2b"
server_key_iv: "cb63437221f7f496e3f5680505ad3289"
server_key_version: "encryptionkey@0"
I20260812 06:24:15.131486 14418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:15.138051 14418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:15.139595 14418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:15.139714 14418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:15.139897 14418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:15.140190 14418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:15.140235 14418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.140326 14418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:15.140358 14418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.146091 14418 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:38181
I20260812 06:24:15.146147 14664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:38181 every 8 connection(s)
I20260812 06:24:15.146396 14418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:24:15.150332 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 14418
I20260812 06:24:15.150431 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:24:15.150602 30781 external_mini_cluster.cc:1428] Setting key 9dee419bfbd4ffefd30d3f845603f501
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515855, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:24:15.155248 14413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:15.146991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:46871 (local address 127.30.15.126:37937)
0812 06:24:15.147043 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:15.147045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:15.147222 (+ 177us) server_negotiation.cc:407] Connection header received
0812 06:24:15.147678 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:15.147679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:15.147688 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:15.147742 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:15.148587 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.149082 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.150008 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.150209 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.150272 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.152668 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:15.152669 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:15.152669 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:15.152676 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:15.153946 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:15.154343 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:15.154344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:15.154344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:15.154399 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:15.154623 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:15.154624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:15.154625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:15.154737 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:15.154802 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:15.155060 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 06:24:15.155155 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:24:15.155393 14668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:15.146959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:46871)
0812 06:24:15.147112 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:15.147150 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:15.147599 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:15.147797 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:15.147800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:15.148326 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:15.148497 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.148502 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.149148 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.149149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.149928 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.149930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.150302 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.150304 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.150436 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.150927 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:15.150936 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:15.152584 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:15.154023 (+ 1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:15.154030 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:15.154032 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:15.154256 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:15.154455 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:15.154455 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:15.154456 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:15.154566 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:15.154805 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:15.154811 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:15.154936 (+ 125us) client_negotiation.cc:769] Sending connection context
0812 06:24:15.155021 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:24:15.155166 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260812 06:24:15.155809 14665 heartbeater.cc:347] Connected to a master server at 127.30.15.126:37937
I20260812 06:24:15.155897 14665 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:15.156064 14665 heartbeater.cc:511] Master 127.30.15.126:37937 requested a full tablet report, sending...
I20260812 06:24:15.156526 14311 ts_manager.cc:194] Registered new tserver with Master: 5880110cdbdf490d9835f21ee92fd963 (127.30.15.65:38181)
I20260812 06:24:15.157119 14311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:46871
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:24:15.173743 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37937
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:15.253407 14675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:15.253590 14675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:15.253612 14675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:15.254737 14675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:15.254779 14675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:15.254805 14675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:24:15.256604 14675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:15.256814 14675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:15.257007 14675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:15.261677 14692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:15.261682 14689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:15.261686 14687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:15.261765 14675 server_base.cc:1034] running on GCE node
I20260812 06:24:15.262131 14675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:15.262336 14675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:15.263465 14675 hybrid_clock.cc:648] HybridClock initialized: now 1786515855263452 us; error 27 us; skew 500 ppm
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515855, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:15.265718 14675 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:24:15.266141 14675 webserver.cc:460] Webserver started at http://127.30.15.66:46401/ using document root <none> and password file <none>
I20260812 06:24:15.266346 14675 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:15.266392 14675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:15.266510 14675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:15.267489 14675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "325cf3bec9c64b359253732db2275326"
format_stamp: "Formatted at 2026-08-12 06:24:15 on dist-test-slave-gjrz"
server_key: "9bfc66ef6b0ac17ca1661e5deeaa247e"
server_key_iv: "b3546b589f5f640c4dae3f3f95916d19"
server_key_version: "encryptionkey@0"
I20260812 06:24:15.267812 14675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "325cf3bec9c64b359253732db2275326"
format_stamp: "Formatted at 2026-08-12 06:24:15 on dist-test-slave-gjrz"
server_key: "9bfc66ef6b0ac17ca1661e5deeaa247e"
server_key_iv: "b3546b589f5f640c4dae3f3f95916d19"
server_key_version: "encryptionkey@0"
I20260812 06:24:15.268963 14675 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:15.269593 14706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.269740 14675 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:15.269817 14675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "325cf3bec9c64b359253732db2275326"
format_stamp: "Formatted at 2026-08-12 06:24:15 on dist-test-slave-gjrz"
server_key: "9bfc66ef6b0ac17ca1661e5deeaa247e"
server_key_iv: "b3546b589f5f640c4dae3f3f95916d19"
server_key_version: "encryptionkey@0"
I20260812 06:24:15.269876 14675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:15.302445 14675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:15.304525 14675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:15.304661 14675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:15.304868 14675 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:15.305161 14675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:15.305195 14675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.305223 14675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:15.305241 14675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.310706 14675 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:43437
I20260812 06:24:15.310765 14917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:43437 every 8 connection(s)
I20260812 06:24:15.311029 14675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515855, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:24:15.318220 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 14675
I20260812 06:24:15.318326 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:24:15.318506 30781 external_mini_cluster.cc:1428] Setting key b1d64cc54120eb568b4c3477c4800e54
I20260812 06:24:15.319160 14413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:15.311704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:35939 (local address 127.30.15.126:37937)
0812 06:24:15.311762 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:15.311764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:15.311927 (+ 163us) server_negotiation.cc:407] Connection header received
0812 06:24:15.312387 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:15.312388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:15.312397 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:15.312450 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:15.313258 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.313750 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.314669 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.314884 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.314938 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.316820 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:15.316822 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:15.316822 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:15.316829 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:15.317871 (+ 1042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:15.318234 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:15.318236 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:15.318236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:15.318293 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:15.318539 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:15.318540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:15.318540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:15.318677 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:15.318735 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:15.318986 (+ 251us) server_negotiation.cc:299] Negotiation successful
0812 06:24:15.319073 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:24:15.319334 14933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:15.311664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:35939)
0812 06:24:15.311815 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:15.311854 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:15.312313 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:15.312500 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:15.312503 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:15.313007 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:15.313194 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.313199 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.313809 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.313809 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.314587 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.314589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.314945 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.314945 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.315037 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.315508 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:15.315516 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:15.316742 (+ 1226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:15.317934 (+ 1192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:15.317940 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:15.317941 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:15.318151 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:15.318374 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:15.318375 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:15.318375 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:15.318479 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:15.318736 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:15.318744 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:15.318862 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 06:24:15.318953 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 06:24:15.319105 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
I20260812 06:24:15.319744 14924 heartbeater.cc:347] Connected to a master server at 127.30.15.126:37937
I20260812 06:24:15.319864 14924 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:15.320039 14924 heartbeater.cc:511] Master 127.30.15.126:37937 requested a full tablet report, sending...
I20260812 06:24:15.320397 14311 ts_manager.cc:194] Registered new tserver with Master: 325cf3bec9c64b359253732db2275326 (127.30.15.66:43437)
I20260812 06:24:15.320842 14311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:35939
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:24:15.342103 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37937
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:15.421558 14945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:15.421727 14945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:15.421748 14945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:15.422821 14945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:15.422854 14945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:15.422878 14945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:24:15.424268 14945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:37937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:15.424440 14945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:15.424613 14945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:15.429164 14953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:15.429291 14945 server_base.cc:1034] running on GCE node
W20260812 06:24:15.429171 14952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:15.429165 14961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:15.429574 14945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:15.429791 14945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:15.430919 14945 hybrid_clock.cc:648] HybridClock initialized: now 1786515855430907 us; error 27 us; skew 500 ppm
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515855, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:15.433254 14945 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:24:15.433660 14945 webserver.cc:460] Webserver started at http://127.30.15.67:40851/ using document root <none> and password file <none>
I20260812 06:24:15.433864 14945 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:15.433911 14945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:15.434087 14945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:15.435012 14945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "588ddd312a284e4e83345c150978fb44"
format_stamp: "Formatted at 2026-08-12 06:24:15 on dist-test-slave-gjrz"
server_key: "7cacee99eb870109299008ec6e1e2d7e"
server_key_iv: "7810dc595e1705f76b2bdee58b78bc67"
server_key_version: "encryptionkey@0"
I20260812 06:24:15.435398 14945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "588ddd312a284e4e83345c150978fb44"
format_stamp: "Formatted at 2026-08-12 06:24:15 on dist-test-slave-gjrz"
server_key: "7cacee99eb870109299008ec6e1e2d7e"
server_key_iv: "7810dc595e1705f76b2bdee58b78bc67"
server_key_version: "encryptionkey@0"
I20260812 06:24:15.436605 14945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:15.437232 14973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.437376 14945 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:15.437454 14945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "588ddd312a284e4e83345c150978fb44"
format_stamp: "Formatted at 2026-08-12 06:24:15 on dist-test-slave-gjrz"
server_key: "7cacee99eb870109299008ec6e1e2d7e"
server_key_iv: "7810dc595e1705f76b2bdee58b78bc67"
server_key_version: "encryptionkey@0"
I20260812 06:24:15.437518 14945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:15.458436 14945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:15.460227 14945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:15.460348 14945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:15.460525 14945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:15.460767 14945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:15.460798 14945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.460824 14945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:15.460840 14945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.466230 14945 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:35141
I20260812 06:24:15.466298 15177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:35141 every 8 connection(s)
I20260812 06:24:15.466562 14945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515855, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:24:15.474759 14413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:15.467173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:58327 (local address 127.30.15.126:37937)
0812 06:24:15.467234 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:15.467236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:15.467434 (+ 198us) server_negotiation.cc:407] Connection header received
0812 06:24:15.467903 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:15.467905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:15.467916 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:15.467966 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:15.468838 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.469331 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.470298 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.470497 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.470559 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.472494 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:15.472496 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:15.472496 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:15.472503 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:15.473770 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:15.474093 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:15.474094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:15.474094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:15.474139 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:15.474307 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:15.474307 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:15.474308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:15.474400 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:15.474443 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:15.474641 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 06:24:15.474695 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:24:15.474917 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:15.467136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:58327)
0812 06:24:15.467304 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:15.467343 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:15.467807 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:15.468030 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:15.468034 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:15.468566 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:15.468740 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.468744 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.469412 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.469413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.470211 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.470213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.470564 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.470566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.470690 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.471109 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:15.471117 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:15.472413 (+ 1296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:15.473840 (+ 1427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:15.473846 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:15.473847 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:15.474038 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:15.474182 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:15.474182 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:15.474182 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:15.474267 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:15.474439 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:15.474442 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:15.474550 (+ 108us) client_negotiation.cc:769] Sending connection context
0812 06:24:15.474622 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:24:15.474732 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260812 06:24:15.475346 15180 heartbeater.cc:347] Connected to a master server at 127.30.15.126:37937
I20260812 06:24:15.475440 15180 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:15.475605 15180 heartbeater.cc:511] Master 127.30.15.126:37937 requested a full tablet report, sending...
I20260812 06:24:15.475960 14311 ts_manager.cc:194] Registered new tserver with Master: 588ddd312a284e4e83345c150978fb44 (127.30.15.67:35141)
I20260812 06:24:15.476312 14311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:58327
I20260812 06:24:15.476512 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 14945
I20260812 06:24:15.476621 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:24:15.476828 30781 external_mini_cluster.cc:1428] Setting key 5686c4b3c1ad2b2303ba22c644340754
I20260812 06:24:15.477599 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab.
Entry for principal oryx/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab.
WARNING: no policy specified for oryx/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab.
Entry for principal oryx/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab.
WARNING: no policy specified for oryx/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab.
Entry for principal oryx/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab.
I20260812 06:24:15.542423 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 14418
I20260812 06:24:15.558902 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 14675
I20260812 06:24:15.574545 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 14945
I20260812 06:24:15.586256 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 14252
I20260812 06:24:15.599997 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:37937
--webserver_interface=127.30.15.126
--webserver_port=40183
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:37937
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:15.678349 15203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:15.678531 15203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:15.678551 15203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:15.679674 15203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:24:15.679713 15203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:15.679725 15203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:15.679744 15203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:24:15.679770 15203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:24:15.681195 15203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:37937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:37937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=40183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:15.681402 15203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:15.681602 15203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:15.686116 15211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:15.686120 15210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:15.686120 15213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:15.686301 15203 server_base.cc:1034] running on GCE node
I20260812 06:24:15.686587 15203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:15.686847 15203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:15.687983 15203 hybrid_clock.cc:648] HybridClock initialized: now 1786515855687964 us; error 31 us; skew 500 ppm
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515855, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:15.690312 15203 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:24:15.690683 15203 webserver.cc:460] Webserver started at http://127.30.15.126:40183/ using document root <none> and password file <none>
I20260812 06:24:15.690886 15203 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:15.690945 15203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:15.692199 15203 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:15.692762 15225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.692910 15203 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:15.692988 15203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "e1c18aaa56274e36a647bd5ec5871269"
format_stamp: "Formatted at 2026-08-12 06:24:14 on dist-test-slave-gjrz"
server_key: "a00e62f739fba814ebb75996b08bfcef"
server_key_iv: "f40f6458c22d511c6b3714ce6405cfa9"
server_key_version: "encryptionkey@0"
I20260812 06:24:15.693265 15203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:15.703536 15203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:15.705111 15203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:15.705209 15203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:15.709122 15203 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:37937
I20260812 06:24:15.709156 15321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:37937 every 8 connection(s)
I20260812 06:24:15.709491 15203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:24:15.710805 15325 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:24:15.711474 15325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269: Bootstrap starting.
I20260812 06:24:15.714485 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 15203
I20260812 06:24:15.714830 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:38181
--local_ip_for_outbound_sockets=127.30.15.65
--tserver_master_addrs=127.30.15.126:37937
--webserver_port=34137
--webserver_interface=127.30.15.65
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.15.65
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:24:15.720588 15325 log.cc:824] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:15.722122 15325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:24:15.722360 15325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269: Bootstrap complete.
I20260812 06:24:15.724443 15325 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c18aaa56274e36a647bd5ec5871269" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37937 } }
I20260812 06:24:15.724658 15325 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c18aaa56274e36a647bd5ec5871269, State: Initialized, Role: FOLLOWER
I20260812 06:24:15.724809 15325 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c18aaa56274e36a647bd5ec5871269" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37937 } }
I20260812 06:24:15.724888 15325 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:24:15.724936 15325 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:24:15.724982 15325 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:24:15.725894 15325 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c18aaa56274e36a647bd5ec5871269" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37937 } }
I20260812 06:24:15.725991 15325 leader_election.cc:302] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1c18aaa56274e36a647bd5ec5871269; no voters:
I20260812 06:24:15.726159 15325 leader_election.cc:288] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:24:15.726219 15333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:24:15.726390 15325 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:24:15.726423 15333 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [term 2 LEADER]: Becoming Leader. State: Replica: e1c18aaa56274e36a647bd5ec5871269, State: Running, Role: LEADER
I20260812 06:24:15.726580 15333 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c18aaa56274e36a647bd5ec5871269" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37937 } }
I20260812 06:24:15.726856 15334 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e1c18aaa56274e36a647bd5ec5871269" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c18aaa56274e36a647bd5ec5871269" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37937 } } }
I20260812 06:24:15.726918 15334 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:15.727213 15336 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1c18aaa56274e36a647bd5ec5871269. Latest consensus state: current_term: 2 leader_uuid: "e1c18aaa56274e36a647bd5ec5871269" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c18aaa56274e36a647bd5ec5871269" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 37937 } } }
I20260812 06:24:15.727320 15343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:24:15.727327 15336 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269 [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:15.727833 15343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:24:15.727964 15343 catalog_manager.cc:1259] Loaded cluster ID: 103377c1a5054e64a7546e57c717a377
I20260812 06:24:15.727999 15343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:24:15.728833 15343 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:24:15.729027 15343 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e1c18aaa56274e36a647bd5ec5871269: Loaded TSK: 0
I20260812 06:24:15.729219 15343 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:24:15.811532 15330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:15.811705 15330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:15.811726 15330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:15.812837 15330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:15.812875 15330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:15.812901 15330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:24:15.814283 15330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.65.keytab
--principal=oryx/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:38181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=34137
--tserver_master_addrs=127.30.15.126:37937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:15.814478 15330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:15.814675 15330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:15.820400 15368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:15.820371 15365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:15.820497 15330 server_base.cc:1034] running on GCE node
W20260812 06:24:15.820385 15371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:15.820801 15330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:15.821039 15330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:15.822183 15330 hybrid_clock.cc:648] HybridClock initialized: now 1786515855822169 us; error 30 us; skew 500 ppm
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515855, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:15.824535 15330 init.cc:377] Logged in from keytab as oryx/127.30.15.65@KRBTEST.COM (short username oryx)
I20260812 06:24:15.824928 15330 webserver.cc:460] Webserver started at http://127.30.15.65:34137/ using document root <none> and password file <none>
I20260812 06:24:15.825138 15330 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:15.825191 15330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:15.826407 15330 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:15.827015 15384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.827167 15330 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:15.827247 15330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "5880110cdbdf490d9835f21ee92fd963"
format_stamp: "Formatted at 2026-08-12 06:24:15 on dist-test-slave-gjrz"
server_key: "b7c46bb1d1fed5c5f92715ae7c29df2b"
server_key_iv: "cb63437221f7f496e3f5680505ad3289"
server_key_version: "encryptionkey@0"
I20260812 06:24:15.827569 15330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:15.841859 15330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:15.843849 15330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:15.843952 15330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:15.844159 15330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:15.844472 15330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:15.844515 15330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.844537 15330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:15.844560 15330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.851236 15330 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:38181
I20260812 06:24:15.851331 15597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:38181 every 8 connection(s)
I20260812 06:24:15.851620 15330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:15.859941 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:15.852226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:55607)
0812 06:24:15.852395 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:15.852436 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:15.852979 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:15.853353 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:15.853356 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:15.854012 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:15.854284 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.854289 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.855339 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.855340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.856564 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.856568 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.857101 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.857101 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.857233 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.857648 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:15.857657 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:15.859815 (+ 2158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
W20260812 06:24:15.860214 15598 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:37937 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.15.126:37937: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
W20260812 06:24:15.860522 15604 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:15.852335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:55607 (local address 127.30.15.126:37937)
0812 06:24:15.852503 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:15.852509 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:15.852549 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:24:15.853149 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:15.853154 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:15.853193 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:15.853293 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:15.854374 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.855231 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.856640 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.857027 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.857096 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.859965 (+ 2869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:55607: BlockingRecv error: recv got EOF from 127.30.15.65:55607 (error 108)
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260812 06:24:15.860617 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 15330
I20260812 06:24:15.860932 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:43437
--local_ip_for_outbound_sockets=127.30.15.66
--tserver_master_addrs=127.30.15.126:37937
--webserver_port=46401
--webserver_interface=127.30.15.66
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.15.66
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:15.864854 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:15.860443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:47989)
0812 06:24:15.860668 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:15.860679 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:15.860728 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:15.860904 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:15.860906 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:15.861064 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:15.861123 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.861125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.862013 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.862014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.862647 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.862649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.862963 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.862964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.863035 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.863378 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:15.863382 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:15.864799 (+ 1417us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210}
W20260812 06:24:15.864948 15605 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:15.860484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:47989 (local address 127.30.15.126:37937)
0812 06:24:15.860630 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:15.860631 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:15.860774 (+ 143us) server_negotiation.cc:407] Connection header received
0812 06:24:15.860795 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:15.860795 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:15.860805 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:15.860867 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:15.861216 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.861922 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.862723 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.862906 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.862957 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.864886 (+ 1929us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:47989: BlockingRecv error: recv got EOF from 127.30.15.65:47989 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":83,"threads_started":1}
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:15.874583 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:15.865269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:44247)
0812 06:24:15.865305 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:15.865314 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:15.865347 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:15.870940 (+ 5593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:15.870940 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:15.871039 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:15.871066 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.871067 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.871916 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.871916 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.872368 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.872369 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.872803 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.872803 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.872834 (+ 31us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.873180 (+ 346us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:15.873183 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:15.874542 (+ 1359us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 06:24:15.874676 15598 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:24:15.874696 15605 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:15.865318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:44247 (local address 127.30.15.126:37937)
0812 06:24:15.870827 (+ 5509us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:15.870829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:15.870838 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:24:15.870859 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:15.870860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:15.870869 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:15.870936 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:15.871139 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.871847 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.872444 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.872743 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.872809 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.874640 (+ 1831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:44247: BlockingRecv error: recv got EOF from 127.30.15.65:44247 (error 108)
Metrics: {"server-negotiator.queue_time_us":5490}
W20260812 06:24:15.943014 15607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:15.943200 15607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:15.943221 15607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:15.944335 15607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:15.944373 15607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:15.944398 15607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:24:15.945714 15607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.66.keytab
--principal=oryx/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:43437
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=46401
--tserver_master_addrs=127.30.15.126:37937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:15.945876 15607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:15.946036 15607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:15.950620 15615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:15.950730 15607 server_base.cc:1034] running on GCE node
W20260812 06:24:15.950624 15617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:15.950624 15614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:15.951026 15607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:15.951241 15607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:15.952392 15607 hybrid_clock.cc:648] HybridClock initialized: now 1786515855952380 us; error 28 us; skew 500 ppm
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515855, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:15.954728 15607 init.cc:377] Logged in from keytab as oryx/127.30.15.66@KRBTEST.COM (short username oryx)
I20260812 06:24:15.955120 15607 webserver.cc:460] Webserver started at http://127.30.15.66:46401/ using document root <none> and password file <none>
I20260812 06:24:15.955344 15607 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:15.955410 15607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:15.956705 15607 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:15.957219 15630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.957373 15607 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.957450 15607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "325cf3bec9c64b359253732db2275326"
format_stamp: "Formatted at 2026-08-12 06:24:15 on dist-test-slave-gjrz"
server_key: "9bfc66ef6b0ac17ca1661e5deeaa247e"
server_key_iv: "b3546b589f5f640c4dae3f3f95916d19"
server_key_version: "encryptionkey@0"
I20260812 06:24:15.957736 15607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:15.972041 15607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:15.973973 15607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:15.974105 15607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:15.974299 15607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:15.974563 15607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:15.974596 15607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.974620 15607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:15.974646 15607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:15.980278 15607 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:43437
I20260812 06:24:15.980333 15817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:43437 every 8 connection(s)
I20260812 06:24:15.980620 15607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:15.986693 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 15607
I20260812 06:24:15.986959 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:35141
--local_ip_for_outbound_sockets=127.30.15.67
--tserver_master_addrs=127.30.15.126:37937
--webserver_port=40851
--webserver_interface=127.30.15.67
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.15.67
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:15.987084 15605 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:15.981233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:57459 (local address 127.30.15.126:37937)
0812 06:24:15.981283 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:15.981285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:15.981461 (+ 176us) server_negotiation.cc:407] Connection header received
0812 06:24:15.981918 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:15.981919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:15.981932 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:15.981982 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:15.982827 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.983343 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.984253 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.984448 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.984493 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.987021 (+ 2528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:57459: BlockingRecv error: recv got EOF from 127.30.15.66:57459 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:24:15.987115 15821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:15.981218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:57459)
0812 06:24:15.981364 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:15.981396 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:15.981826 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:15.982037 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:15.982041 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:15.982572 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:15.982747 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.982752 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.983405 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.983405 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.984179 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.984182 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.984500 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.984501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.984599 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.984962 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:15.984969 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:15.986938 (+ 1969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
W20260812 06:24:15.987344 15819 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:37937 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.15.126:37937: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:15.991282 15821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:15.987526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:41745)
0812 06:24:15.987565 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:15.987575 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:15.987612 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:15.987716 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:15.987716 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:15.987828 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:15.987866 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.987867 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.988440 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.988441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.988920 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.988921 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.989248 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.989250 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.989312 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.989669 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:15.989673 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:15.991219 (+ 1546us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 06:24:15.991407 15605 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:15.987578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:41745 (local address 127.30.15.126:37937)
0812 06:24:15.987619 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:15.987621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:15.987631 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:24:15.987661 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:15.987662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:15.987673 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:15.987713 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:15.987929 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.988376 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.988992 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.989193 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.989244 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.991349 (+ 2105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:41745: BlockingRecv error: recv got EOF from 127.30.15.66:41745 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:15 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:15.995533 15821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:15.991486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:41533)
0812 06:24:15.991606 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:15.991614 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:15.991650 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:15.991761 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:15.991761 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:15.991860 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:15.991884 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.991885 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.992669 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.992669 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.993120 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:15.993121 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.993522 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.993522 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:15.993585 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.993960 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:15.993964 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:15.995493 (+ 1529us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":77,"threads_started":1}
W20260812 06:24:15.995674 15605 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:15.991525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:41533 (local address 127.30.15.126:37937)
0812 06:24:15.991567 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:15.991569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:15.991646 (+ 77us) server_negotiation.cc:407] Connection header received
0812 06:24:15.991688 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:15.991689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:15.991698 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:15.991758 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:15.991941 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.992603 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.993183 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:15.993455 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:15.993523 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:15.995621 (+ 2098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:41533: BlockingRecv error: recv got EOF from 127.30.15.66:41533 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260812 06:24:15.995795 15819 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:24:16.068542 15822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:16.068717 15822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:16.068738 15822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:16.069841 15822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:16.069880 15822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:16.069906 15822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:24:16.071312 15822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/krb5kdc/oryx_127.30.15.67.keytab
--principal=oryx/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:35141
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=40851
--tserver_master_addrs=127.30.15.126:37937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:16.071528 15822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:16.071718 15822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:16.076284 15831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:16.076300 15836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:16.076329 15822 server_base.cc:1034] running on GCE node
W20260812 06:24:16.076321 15830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:16.076644 15822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:16.076865 15822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:16.078178 15822 hybrid_clock.cc:648] HybridClock initialized: now 1786515856078158 us; error 34 us; skew 500 ppm
Aug 12 06:24:16 dist-test-slave-gjrz krb5kdc[14229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515856, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:16.080502 15822 init.cc:377] Logged in from keytab as oryx/127.30.15.67@KRBTEST.COM (short username oryx)
I20260812 06:24:16.080899 15822 webserver.cc:460] Webserver started at http://127.30.15.67:40851/ using document root <none> and password file <none>
I20260812 06:24:16.081084 15822 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:16.081135 15822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:16.082324 15822 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:16.082820 15847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:16.082965 15822 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:16.083035 15822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "588ddd312a284e4e83345c150978fb44"
format_stamp: "Formatted at 2026-08-12 06:24:15 on dist-test-slave-gjrz"
server_key: "7cacee99eb870109299008ec6e1e2d7e"
server_key_iv: "7810dc595e1705f76b2bdee58b78bc67"
server_key_version: "encryptionkey@0"
I20260812 06:24:16.083357 15822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:16.098604 15822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:16.100495 15822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:16.100623 15822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:16.100839 15822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:16.101119 15822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:16.101154 15822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:16.101173 15822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:16.101184 15822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:16.106966 15822 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:35141
I20260812 06:24:16.107029 16046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:35141 every 8 connection(s)
I20260812 06:24:16.107357 15822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:24:16.112308 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 15822
Aug 12 06:24:16 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:16 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:24:16.114614 15605 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:16.108094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:45815 (local address 127.30.15.126:37937)
0812 06:24:16.108137 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:16.108140 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:16.108330 (+ 190us) server_negotiation.cc:407] Connection header received
0812 06:24:16.108849 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:16.108851 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:16.108864 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:16.108912 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:16.109844 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.110341 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.111314 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.111512 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.111568 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:16.114567 (+ 2999us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:45815: BlockingRecv error: recv got EOF from 127.30.15.67:45815 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:24:16.114691 16049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:16.108026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:45815)
0812 06:24:16.108191 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:16.108233 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:16.108746 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:16.108994 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:16.108998 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:16.109556 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:16.109742 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:16.109747 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.110426 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.110427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:16.111224 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:16.111227 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.111584 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.111584 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:16.111708 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:16.112121 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:16.112145 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:16.114498 (+ 2353us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":67,"threads_started":1}
W20260812 06:24:16.114910 16047 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:37937 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.15.126:37937: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Aug 12 06:24:16 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:16 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:16.119196 16049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:16.115106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:39795)
0812 06:24:16.115200 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:16.115210 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:16.115253 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:16.115382 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:16.115382 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:16.115513 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:16.115556 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:16.115557 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.116252 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.116253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:16.116770 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:16.116772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.117100 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.117100 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:16.117165 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:16.117464 (+ 299us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:16.117468 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:16.119139 (+ 1671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":80}
W20260812 06:24:16.119290 15605 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:16.115162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:39795 (local address 127.30.15.126:37937)
0812 06:24:16.115204 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:16.115206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:16.115240 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:24:16.115317 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:16.115318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:16.115326 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:16.115377 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:16.115620 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.116179 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.116844 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.117041 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.117093 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:16.119214 (+ 2121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:39795: BlockingRecv error: recv got EOF from 127.30.15.67:39795 (error 108)
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":19}
I20260812 06:24:16.120025 15604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:16.112797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33118 (local address 127.30.15.126:37937)
0812 06:24:16.112867 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:16.112869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:16.112879 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:24:16.112936 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:16.112937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:16.112952 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:16.113006 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:16.113582 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.114153 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.115222 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.115454 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.115510 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:16.116611 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:16.116615 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:16.116615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:16.116626 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:16.118397 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:16.118799 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:16.118802 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:16.118803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:16.118934 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:16.119123 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:16.119124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:16.119124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:16.119429 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:16.119553 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:16.119703 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 06:24:16.119965 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 06:24:16 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:16 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:16.123215 16049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:16.119732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:49539)
0812 06:24:16.119768 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:16.119776 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:16.119809 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:16.119908 (+ 99us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:16.119909 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:16.120007 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:16.120032 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:16.120033 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.120751 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.120752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:16.121269 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:16.121271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.121560 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.121561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:16.121593 (+ 32us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:16.121862 (+ 269us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:16.121865 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:16.123176 (+ 1311us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 06:24:16.123337 15605 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:16.119781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:49539 (local address 127.30.15.126:37937)
0812 06:24:16.119816 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:16.119817 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:16.119826 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:24:16.119845 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:16.119846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:16.119853 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:16.119895 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:16.120100 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.120667 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.121329 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.121508 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.121553 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:16.123254 (+ 1701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:49539: BlockingRecv error: recv got EOF from 127.30.15.67:49539 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 06:24:16.123351 16047 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 12 06:24:16 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:16 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:16.879094 16052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:16.874978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:60451)
0812 06:24:16.875100 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:16.875111 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:16.875162 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:16.875301 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:16.875302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:16.875455 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:16.875506 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:16.875508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.876096 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.876096 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:16.876637 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:16.876639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.876914 (+ 275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.876915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:16.876951 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:16.877330 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:16.877334 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:16.879000 (+ 1666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
W20260812 06:24:16.879160 16054 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:16.875068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:60451 (local address 127.30.15.126:37937)
0812 06:24:16.875180 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:16.875182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:16.875189 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:24:16.875209 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:16.875210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:16.875220 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:16.875288 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:16.875561 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.876046 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.876687 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.876867 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.876912 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:16.879101 (+ 2189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:60451: BlockingRecv error: recv got EOF from 127.30.15.65:60451 (error 108)
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":57,"threads_started":1}
Aug 12 06:24:16 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:16 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:17.000334 16055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:16.996125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:60845)
0812 06:24:16.996236 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:16.996246 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:16.996301 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:16.996404 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:16.996405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:16.996582 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:16.996631 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:16.996633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.997223 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.997223 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:16.997760 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:16.997761 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.998029 (+ 268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.998030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:16.998072 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:16.998442 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:16.998446 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:17.000243 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":52,"threads_started":1}
W20260812 06:24:17.000392 16054 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:16.996178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:60845 (local address 127.30.15.126:37937)
0812 06:24:16.996240 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:16.996242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:16.996294 (+ 52us) server_negotiation.cc:407] Connection header received
0812 06:24:16.996339 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:16.996340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:16.996349 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:16.996395 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:16.996684 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.997169 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.997813 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:16.997986 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:16.998026 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:17.000342 (+ 2316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:60845: BlockingRecv error: recv got EOF from 127.30.15.66:60845 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 12 06:24:17 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:17 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:17.128202 16056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:17.123679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:50175)
0812 06:24:17.123785 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:17.123798 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:17.123865 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:17.123987 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:17.123987 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:17.124164 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:17.124214 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:17.124216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:17.124859 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:17.124860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:17.125622 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:17.125625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:17.126015 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:17.126016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:17.126082 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:17.126448 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:17.126452 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:17.128137 (+ 1685us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":59,"threads_started":1}
W20260812 06:24:17.128281 16054 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:17.123749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:50175 (local address 127.30.15.126:37937)
0812 06:24:17.123809 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:17.123812 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:17.123852 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:24:17.123926 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:17.123927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:17.123939 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:17.123981 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:17.124286 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:17.124787 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:17.125692 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:17.125944 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:17.125994 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:17.128223 (+ 2229us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:50175: BlockingRecv error: recv got EOF from 127.30.15.67:50175 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 12 06:24:17 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:17 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:17.883745 16057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:17.879531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:36801)
0812 06:24:17.879673 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:17.879683 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:17.879730 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:17.879845 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:17.879846 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:17.879997 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:17.880055 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:17.880057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:17.880654 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:17.880654 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:17.881176 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:17.881177 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:17.881447 (+ 270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:17.881447 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:17.881484 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:17.881926 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:17.881931 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:17.883672 (+ 1741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":89,"threads_started":1}
W20260812 06:24:17.883831 16058 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:17.879623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:36801 (local address 127.30.15.126:37937)
0812 06:24:17.879731 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:17.879733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:17.879760 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:24:17.879780 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:17.879780 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:17.879790 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:17.879835 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:17.880105 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:17.880601 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:17.881226 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:17.881402 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:17.881442 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:17.883769 (+ 2327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:36801: BlockingRecv error: recv got EOF from 127.30.15.65:36801 (error 108)
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":51,"threads_started":1}
Aug 12 06:24:18 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:18 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:18.005156 16060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:18.000777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:38557)
0812 06:24:18.000911 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:18.000923 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:18.000988 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:18.001140 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:18.001141 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:18.001311 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:18.001362 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:18.001365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:18.002011 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:18.002012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:18.002534 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:18.002543 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:18.002866 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:18.002866 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:18.002921 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:18.003389 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:18.003394 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:18.005098 (+ 1704us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":72,"threads_started":1}
W20260812 06:24:18.005246 16058 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:18.000851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:38557 (local address 127.30.15.126:37937)
0812 06:24:18.000915 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:18.000917 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:18.000978 (+ 61us) server_negotiation.cc:407] Connection header received
0812 06:24:18.001066 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:18.001067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:18.001079 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:18.001125 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:18.001434 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:18.001940 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:18.002616 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:18.002809 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:18.002861 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:18.005188 (+ 2327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:38557: BlockingRecv error: recv got EOF from 127.30.15.66:38557 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 06:24:18 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:18 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:18.132843 16061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:18.128601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:41563)
0812 06:24:18.128716 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:18.128727 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:18.128772 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:18.128880 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:18.128881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:18.129036 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:18.129099 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:18.129101 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:18.129686 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:18.129687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:18.130253 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:18.130255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:18.130646 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:18.130647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:18.130710 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:18.131096 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:18.131100 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:18.132786 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":58,"threads_started":1}
W20260812 06:24:18.132931 16058 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:18.128707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:41563 (local address 127.30.15.126:37937)
0812 06:24:18.128761 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:18.128762 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:18.128770 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:18.128813 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:18.128814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:18.128825 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:18.128869 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:18.129150 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:18.129635 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:18.130332 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:18.130572 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:18.130639 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:18.132869 (+ 2230us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:41563: BlockingRecv error: recv got EOF from 127.30.15.67:41563 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 12 06:24:18 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:18 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:18.888347 16065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:18.884156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:45059)
0812 06:24:18.884283 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:18.884293 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:18.884350 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:18.884468 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:18.884469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:18.884634 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:18.884684 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:18.884686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:18.885329 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:18.885329 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:18.885915 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:18.885918 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:18.886249 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:18.886250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:18.886297 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:18.886675 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:18.886678 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:18.888289 (+ 1611us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
W20260812 06:24:18.888440 16066 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:18.884208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:45059 (local address 127.30.15.126:37937)
0812 06:24:18.884306 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:18.884308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:18.884334 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:24:18.884395 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:18.884395 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:18.884406 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:18.884459 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:18.884730 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:18.885276 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:18.885979 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:18.886194 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:18.886241 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:18.888374 (+ 2133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:45059: BlockingRecv error: recv got EOF from 127.30.15.65:45059 (error 108)
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":47,"threads_started":1}
Aug 12 06:24:19 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:19 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:19.010107 16067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:19.005593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:57635)
0812 06:24:19.005730 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:19.005740 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:19.005795 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:19.005910 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:19.005911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:19.006087 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:19.006139 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:19.006141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:19.006770 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:19.006771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:19.007444 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:19.007448 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:19.007863 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:19.007864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:19.007908 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:19.008299 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:19.008303 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:19.010045 (+ 1742us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":59,"threads_started":1}
W20260812 06:24:19.010245 16066 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:19.005650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:57635 (local address 127.30.15.126:37937)
0812 06:24:19.005694 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:19.005696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:19.005780 (+ 84us) server_negotiation.cc:407] Connection header received
0812 06:24:19.005838 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:19.005839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:19.005849 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:19.005898 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:19.006187 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:19.006688 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:19.007527 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:19.007801 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:19.007857 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:19.010182 (+ 2325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:57635: BlockingRecv error: recv got EOF from 127.30.15.66:57635 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 12 06:24:19 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:19 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:19.137720 16068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:19.133270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:43407)
0812 06:24:19.133395 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:19.133404 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:19.133454 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:19.133584 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:19.133585 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:19.133745 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:19.133798 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:19.133800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:19.134539 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:19.134540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:19.135159 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:19.135162 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:19.135513 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:19.135513 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:19.135550 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:19.135948 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:19.135952 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:19.137659 (+ 1707us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":65,"threads_started":1}
W20260812 06:24:19.137806 16066 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:19.133335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:43407 (local address 127.30.15.126:37937)
0812 06:24:19.133425 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:19.133427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:19.133438 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:24:19.133504 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:19.133504 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:19.133517 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:19.133566 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:19.133880 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:19.134462 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:19.135221 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:19.135461 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:19.135515 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:19.137744 (+ 2229us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:43407: BlockingRecv error: recv got EOF from 127.30.15.67:43407 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 12 06:24:19 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:19 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:19.893174 16071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:19.888762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:57319)
0812 06:24:19.888892 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:19.888902 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:19.888951 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:19.889084 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:19.889085 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:19.889239 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:19.889296 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:19.889297 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:19.889905 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:19.889906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:19.890471 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:19.890473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:19.890871 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:19.890872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:19.890928 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:19.891404 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:19.891409 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:19.893117 (+ 1708us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":62,"threads_started":1}
W20260812 06:24:19.893275 16072 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:19.888815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:57319 (local address 127.30.15.126:37937)
0812 06:24:19.888924 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:19.888926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:19.888935 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:24:19.889001 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:19.889001 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:19.889012 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:19.889073 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:19.889343 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:19.889835 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:19.890563 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:19.890802 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:19.890863 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:19.893207 (+ 2344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:57319: BlockingRecv error: recv got EOF from 127.30.15.65:57319 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":55,"threads_started":1}
Aug 12 06:24:20 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:20 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:20.019578 16073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:20.010541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:55357)
0812 06:24:20.010680 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:20.010692 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:20.010760 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:20.010893 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:20.010893 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:20.011069 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:20.011121 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:20.011123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:20.011810 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:20.011811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:20.012354 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:20.012356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:20.012713 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:20.012714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:20.012768 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:20.017833 (+ 5065us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:20.017839 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:20.019501 (+ 1662us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
W20260812 06:24:20.019647 16072 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:20.010612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:55357 (local address 127.30.15.126:37937)
0812 06:24:20.010684 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:20.010686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:20.010751 (+ 65us) server_negotiation.cc:407] Connection header received
0812 06:24:20.010824 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:20.010825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:20.010837 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:20.010879 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:20.011196 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:20.011739 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:20.012433 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:20.012640 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:20.012695 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:20.019593 (+ 6898us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:55357: BlockingRecv error: recv got EOF from 127.30.15.66:55357 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 12 06:24:20 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:20 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:20.142369 16077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:20.138127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:56213)
0812 06:24:20.138271 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:20.138281 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:20.138338 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:20.138454 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:20.138454 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:20.138616 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:20.138669 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:20.138670 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:20.139377 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:20.139378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:20.139905 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:20.139907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:20.140192 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:20.140192 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:20.140229 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:20.140657 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:20.140662 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:20.142307 (+ 1645us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
W20260812 06:24:20.142449 16072 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:20.138185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:56213 (local address 127.30.15.126:37937)
0812 06:24:20.138253 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:20.138256 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:20.138331 (+ 75us) server_negotiation.cc:407] Connection header received
0812 06:24:20.138382 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:20.138382 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:20.138395 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:20.138440 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:20.138716 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:20.139317 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:20.139963 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:20.140146 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:20.140188 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:20.142388 (+ 2200us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:56213: BlockingRecv error: recv got EOF from 127.30.15.67:56213 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 12 06:24:20 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:20 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:20.898090 16078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:20.893596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:54679)
0812 06:24:20.893722 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:20.893732 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:20.893780 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:20.893892 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:20.893892 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:20.894053 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:20.894108 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:20.894110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:20.894784 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:20.894785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:20.895353 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:20.895355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:20.895697 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:20.895697 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:20.895744 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:20.896146 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:20.896150 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:20.898018 (+ 1868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":59,"threads_started":1}
W20260812 06:24:20.898168 16079 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:20.893665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:54679 (local address 127.30.15.126:37937)
0812 06:24:20.893780 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:20.893781 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:20.893789 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:20.893813 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:20.893814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:20.893825 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:20.893883 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:20.894190 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:20.894707 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:20.895417 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:20.895639 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:20.895690 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:20.898105 (+ 2415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:54679: BlockingRecv error: recv got EOF from 127.30.15.65:54679 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":61,"threads_started":1}
Aug 12 06:24:21 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:21 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:21.024168 16080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:21.020018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:56301)
0812 06:24:21.020163 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:21.020177 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:21.020237 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:21.020370 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:21.020371 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:21.020525 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:21.020587 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:21.020589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:21.021214 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:21.021215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:21.021758 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:21.021759 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:21.022061 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:21.022062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:21.022096 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:21.022475 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:21.022479 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:21.024109 (+ 1630us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
W20260812 06:24:21.024340 16079 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:21.020184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:56301 (local address 127.30.15.126:37937)
0812 06:24:21.020233 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:21.020234 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:21.020242 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:21.020302 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:21.020303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:21.020312 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:21.020361 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:21.020636 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:21.021158 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:21.021810 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:21.022012 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:21.022057 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:21.024281 (+ 2224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:56301: BlockingRecv error: recv got EOF from 127.30.15.66:56301 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 12 06:24:21 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:21 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:21.146991 16084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:21.142790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:49091)
0812 06:24:21.142961 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:21.142972 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:21.143053 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:21.143193 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:21.143194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:21.143368 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:21.143423 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:21.143425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:21.144095 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:21.144095 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:21.144613 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:21.144615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:21.144896 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:21.144897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:21.144932 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:21.145322 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:21.145327 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:21.146930 (+ 1603us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":72,"threads_started":1}
W20260812 06:24:21.147083 16079 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:21.142876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:49091 (local address 127.30.15.126:37937)
0812 06:24:21.142959 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:21.142961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:21.143020 (+ 59us) server_negotiation.cc:407] Connection header received
0812 06:24:21.143109 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:21.143110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:21.143123 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:21.143184 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:21.143519 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:21.144035 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:21.144668 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:21.144848 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:21.144895 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:21.147021 (+ 2126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:49091: BlockingRecv error: recv got EOF from 127.30.15.67:49091 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 06:24:21 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:21 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:21.902829 16085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:21.898521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:56055)
0812 06:24:21.898670 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:21.898681 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:21.898731 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:21.898852 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:21.898853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:21.899009 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:21.899069 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:21.899071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:21.899736 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:21.899737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:21.900302 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:21.900304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:21.900617 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:21.900618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:21.900661 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:21.901079 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:21.901083 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:21.902766 (+ 1683us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":67,"threads_started":1}
W20260812 06:24:21.902956 16086 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:21.898596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:56055 (local address 127.30.15.126:37937)
0812 06:24:21.898734 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:21.898736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:21.898746 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:24:21.898768 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:21.898768 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:21.898778 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:21.898837 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:21.899143 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:21.899669 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:21.900365 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:21.900562 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:21.900609 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:21.902857 (+ 2248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:56055: BlockingRecv error: recv got EOF from 127.30.15.65:56055 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
Aug 12 06:24:22 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:22 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:22.029208 16088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:22.024601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:59131)
0812 06:24:22.024774 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:22.024786 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:22.024858 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:22.024987 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:22.024988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:22.025179 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:22.025231 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:22.025233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:22.025880 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:22.025882 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:22.026459 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:22.026461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:22.026818 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:22.026819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:22.026872 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:22.027322 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:22.027327 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:22.029131 (+ 1804us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":94,"threads_started":1}
W20260812 06:24:22.029276 16086 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:22.024682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:59131 (local address 127.30.15.126:37937)
0812 06:24:22.024772 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:22.024774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:22.024845 (+ 71us) server_negotiation.cc:407] Connection header received
0812 06:24:22.024921 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:22.024922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:22.024933 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:22.024983 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:22.025301 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:22.025805 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:22.026531 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:22.026752 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:22.026818 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:22.029225 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:59131: BlockingRecv error: recv got EOF from 127.30.15.66:59131 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 06:24:22 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:22 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:22.151970 16089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:22.147415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:38163)
0812 06:24:22.147562 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:22.147575 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:22.147636 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:22.147775 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:22.147776 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:22.147946 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:22.147999 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:22.148001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:22.148645 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:22.148646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:22.149367 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:22.149370 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:22.149697 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:22.149698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:22.149759 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:22.150180 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:22.150186 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:22.151891 (+ 1705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
W20260812 06:24:22.152038 16086 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:22.147526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:38163 (local address 127.30.15.126:37937)
0812 06:24:22.147607 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:22.147608 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:22.147616 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:22.147682 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:22.147683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:22.147698 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:22.147754 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:22.148071 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:22.148572 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:22.149437 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:22.149636 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:22.149690 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:22.151984 (+ 2294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:38163: BlockingRecv error: recv got EOF from 127.30.15.67:38163 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 12 06:24:22 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:22 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:22.907388 16090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:22.903252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:55985)
0812 06:24:22.903409 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:22.903422 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:22.903482 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:22.903595 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:22.903595 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:22.903749 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:22.903800 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:22.903802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:22.904417 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:22.904418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:22.904944 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:22.904946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:22.905255 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:22.905255 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:22.905291 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:22.905687 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:22.905691 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:22.907331 (+ 1640us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":69,"threads_started":1}
W20260812 06:24:22.907500 16092 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:22.903350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:55985 (local address 127.30.15.126:37937)
0812 06:24:22.903478 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:22.903480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:22.903489 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:24:22.903526 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:22.903527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:22.903538 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:22.903584 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:22.903853 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:22.904359 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:22.905008 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:22.905203 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:22.905253 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:22.907415 (+ 2162us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:55985: BlockingRecv error: recv got EOF from 127.30.15.65:55985 (error 108)
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":67,"threads_started":1}
Aug 12 06:24:23 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:23 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:23.033938 16093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:23.029620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:57543)
0812 06:24:23.029739 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:23.029748 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:23.029815 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:23.029971 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:23.029972 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:23.030134 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:23.030188 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:23.030191 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:23.030792 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:23.030792 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:23.031397 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:23.031400 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:23.031716 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:23.031716 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:23.031752 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:23.032179 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:23.032184 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:23.033879 (+ 1695us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":56,"threads_started":1}
W20260812 06:24:23.034008 16092 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:23.029659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:57543 (local address 127.30.15.126:37937)
0812 06:24:23.029710 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:23.029712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:23.029806 (+ 94us) server_negotiation.cc:407] Connection header received
0812 06:24:23.029860 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:23.029861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:23.029872 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:23.029920 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:23.030242 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:23.030734 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:23.031462 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:23.031659 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:23.031707 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:23.033951 (+ 2244us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:57543: BlockingRecv error: recv got EOF from 127.30.15.66:57543 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 12 06:24:23 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:23 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:23.156862 16096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:23.152455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:59185)
0812 06:24:23.152590 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:23.152604 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:23.152678 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:23.152817 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:23.152818 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:23.152998 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:23.153051 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:23.153053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:23.153703 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:23.153705 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:23.154243 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:23.154245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:23.154576 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:23.154577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:23.154637 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:23.155119 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:23.155124 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:23.156786 (+ 1662us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":73,"threads_started":1}
W20260812 06:24:23.156955 16092 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:23.152547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:59185 (local address 127.30.15.126:37937)
0812 06:24:23.152624 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:23.152626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:23.152656 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:24:23.152740 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:23.152741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:23.152754 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:23.152801 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:23.153123 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:23.153633 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:23.154321 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:23.154518 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:23.154570 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:23.156890 (+ 2320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:59185: BlockingRecv error: recv got EOF from 127.30.15.67:59185 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 06:24:23 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:23 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:23.912240 16097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:23.907786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:35311)
0812 06:24:23.907905 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:23.907915 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:23.907963 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:23.908242 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:23.908242 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:23.908398 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:23.908450 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:23.908451 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:23.909069 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:23.909070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:23.909609 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:23.909611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:23.909898 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:23.909898 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:23.909935 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:23.910339 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:23.910343 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:23.912167 (+ 1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":57,"threads_started":1}
W20260812 06:24:23.912372 16098 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:23.907999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:35311 (local address 127.30.15.126:37937)
0812 06:24:23.908132 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:23.908133 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:23.908141 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:23.908161 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:23.908162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:23.908172 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:23.908232 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:23.908501 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:23.909009 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:23.909664 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:23.909850 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:23.909895 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:23.912295 (+ 2400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:35311: BlockingRecv error: recv got EOF from 127.30.15.65:35311 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":65,"threads_started":1}
Aug 12 06:24:24 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:24 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:24.038920 16099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:24.034349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:55951)
0812 06:24:24.034470 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:24.034481 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:24.034551 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:24.034679 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:24.034680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:24.034836 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:24.034887 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:24.034889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:24.035693 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:24.035694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:24.036217 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:24.036218 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:24.036554 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:24.036555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:24.036592 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:24.036974 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:24.036978 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:24.038828 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":54,"threads_started":1}
W20260812 06:24:24.038971 16098 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:24.034395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:55951 (local address 127.30.15.126:37937)
0812 06:24:24.034471 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:24.034472 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:24.034564 (+ 92us) server_negotiation.cc:407] Connection header received
0812 06:24:24.034610 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:24.034611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:24.034624 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:24.034665 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:24.034951 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:24.035630 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:24.036288 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:24.036495 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:24.036548 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:24.038918 (+ 2370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:55951: BlockingRecv error: recv got EOF from 127.30.15.66:55951 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 06:24:24 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:24 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:24.161618 16102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:24.157288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:56451)
0812 06:24:24.157405 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:24.157414 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:24.157470 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:24.157588 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:24.157589 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:24.157747 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:24.157799 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:24.157801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:24.158464 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:24.158465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:24.158985 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:24.158986 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:24.159350 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:24.159351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:24.159395 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:24.159780 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:24.159784 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:24.161540 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":61,"threads_started":1}
W20260812 06:24:24.161690 16098 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:24.157343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:56451 (local address 127.30.15.126:37937)
0812 06:24:24.157404 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:24.157405 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:24.157466 (+ 61us) server_negotiation.cc:407] Connection header received
0812 06:24:24.157525 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:24.157526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:24.157538 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:24.157577 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:24.157888 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:24.158408 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:24.159055 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:24.159243 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:24.159344 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:24.161628 (+ 2284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:56451: BlockingRecv error: recv got EOF from 127.30.15.67:56451 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 12 06:24:24 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:24 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:24.917160 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:24.912689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:48275)
0812 06:24:24.912817 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:24.912828 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:24.912879 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:24.913013 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:24.913014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:24.913179 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:24.913232 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:24.913233 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:24.913847 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:24.913847 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:24.914384 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:24.914385 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:24.914715 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:24.914715 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:24.914752 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:24.915160 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:24.915165 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:24.917082 (+ 1917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":68,"threads_started":1}
W20260812 06:24:24.917248 16108 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:24.912769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:48275 (local address 127.30.15.126:37937)
0812 06:24:24.912872 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:24.912874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:24.912883 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:24:24.912938 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:24.912938 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:24.912948 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:24.913003 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:24.913292 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:24.913791 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:24.914456 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:24.914660 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:24.914712 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:24.917186 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:48275: BlockingRecv error: recv got EOF from 127.30.15.65:48275 (error 108)
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":51,"threads_started":1}
Aug 12 06:24:25 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:25 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:25.046551 16110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:25.039421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:44623)
0812 06:24:25.039557 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:25.039570 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:25.039634 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:25.039770 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:25.039771 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:25.039945 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:25.039998 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:25.040001 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:25.040662 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:25.040663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:25.041220 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:25.041222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:25.041546 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:25.041546 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:25.041588 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:25.044637 (+ 3049us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:25.044642 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:25.046473 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
W20260812 06:24:25.046617 16108 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:25.039517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:44623 (local address 127.30.15.126:37937)
0812 06:24:25.039597 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:25.039599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:25.039615 (+ 16us) server_negotiation.cc:407] Connection header received
0812 06:24:25.039690 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:25.039691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:25.039703 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:25.039759 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:25.040077 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:25.040576 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:25.041292 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:25.041488 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:25.041541 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:25.046563 (+ 5022us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:44623: BlockingRecv error: recv got EOF from 127.30.15.66:44623 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 12 06:24:25 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:25 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:25.166664 16111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:25.162092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:33225)
0812 06:24:25.162234 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:25.162246 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:25.162310 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:25.162451 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:25.162452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:25.162635 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:25.162687 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:25.162689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:25.163455 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:25.163456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:25.164132 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:25.164136 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:25.164458 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:25.164459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:25.164511 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:25.164971 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:25.164976 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:25.166603 (+ 1627us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
W20260812 06:24:25.166750 16108 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:25.162143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:33225 (local address 127.30.15.126:37937)
0812 06:24:25.162195 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:25.162197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:25.162298 (+ 101us) server_negotiation.cc:407] Connection header received
0812 06:24:25.162369 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:25.162370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:25.162384 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:25.162434 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:25.162756 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:25.163347 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:25.164198 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:25.164387 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:25.164438 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:25.166687 (+ 2249us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:33225: BlockingRecv error: recv got EOF from 127.30.15.67:33225 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 12 06:24:25 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:25 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:25.921911 16113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:25.917615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:42961)
0812 06:24:25.917769 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:25.917782 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:25.917850 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:25.917980 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:25.917980 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:25.918151 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:25.918204 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:25.918205 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:25.918810 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:25.918810 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:25.919412 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:25.919415 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:25.919709 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:25.919710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:25.919747 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:25.920197 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:25.920202 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:25.921810 (+ 1608us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":74,"threads_started":1}
W20260812 06:24:25.921972 16116 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:25.917680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:42961 (local address 127.30.15.126:37937)
0812 06:24:25.917784 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:25.917787 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:25.917844 (+ 57us) server_negotiation.cc:407] Connection header received
0812 06:24:25.917902 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:25.917902 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:25.917913 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:25.917960 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:25.918255 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:25.918757 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:25.919472 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:25.919662 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:25.919705 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:25.921910 (+ 2205us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:42961: BlockingRecv error: recv got EOF from 127.30.15.65:42961 (error 108)
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":53,"threads_started":1}
Aug 12 06:24:26 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:26 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:26.051640 16118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:26.047068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:53519)
0812 06:24:26.047220 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:26.047230 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:26.047321 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:26.047499 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:26.047501 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:26.047669 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:26.047726 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:26.047728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:26.048347 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:26.048347 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:26.048878 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:26.048880 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:26.049171 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:26.049172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:26.049213 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:26.049662 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:26.049666 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:26.051556 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
W20260812 06:24:26.051702 16116 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:26.047148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:53519 (local address 127.30.15.126:37937)
0812 06:24:26.047236 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:26.047238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:26.047288 (+ 50us) server_negotiation.cc:407] Connection header received
0812 06:24:26.047378 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:26.047378 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:26.047390 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:26.047453 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:26.047793 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:26.048289 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:26.048939 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:26.049122 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:26.049164 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:26.051652 (+ 2488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:53519: BlockingRecv error: recv got EOF from 127.30.15.66:53519 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 12 06:24:26 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:26 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:26.171545 16121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:26.167128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:54977)
0812 06:24:26.167280 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:26.167292 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:26.167350 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:26.167480 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:26.167480 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:26.167639 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:26.167692 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:26.167694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:26.168293 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:26.168294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:26.168831 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:26.168832 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:26.169188 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:26.169189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:26.169245 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:26.169661 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:26.169666 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:26.171472 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":60,"threads_started":1}
W20260812 06:24:26.171629 16116 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:26.167256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:54977 (local address 127.30.15.126:37937)
0812 06:24:26.167334 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:26.167336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:26.167344 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:26.167402 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:26.167403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:26.167415 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:26.167465 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:26.167741 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:26.168232 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:26.168897 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:26.169104 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:26.169155 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:26.171563 (+ 2408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:54977: BlockingRecv error: recv got EOF from 127.30.15.67:54977 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 06:24:26 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:26 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:26.926857 16122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:26.922357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:39057)
0812 06:24:26.922544 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:26.922557 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:26.922631 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:26.922794 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:26.922795 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:26.923023 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:26.923084 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:26.923087 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:26.923760 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:26.923761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:26.924323 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:26.924324 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:26.924636 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:26.924637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:26.924690 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:26.925079 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:26.925083 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:26.926791 (+ 1708us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":106,"threads_started":1}
W20260812 06:24:26.926923 16123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:26.922447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:39057 (local address 127.30.15.126:37937)
0812 06:24:26.922582 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:26.922584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:26.922652 (+ 68us) server_negotiation.cc:407] Connection header received
0812 06:24:26.922687 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:26.922688 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:26.922702 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:26.922778 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:26.923162 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:26.923678 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:26.924384 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:26.924567 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:26.924609 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:26.926864 (+ 2255us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:39057: BlockingRecv error: recv got EOF from 127.30.15.65:39057 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":49,"threads_started":1}
Aug 12 06:24:27 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:27 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:27.056377 16125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:27.052072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:37297)
0812 06:24:27.052218 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:27.052231 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:27.052301 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:27.052436 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:27.052437 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:27.052650 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:27.052699 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:27.052702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:27.053358 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:27.053360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:27.053916 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:27.053918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:27.054269 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:27.054270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:27.054327 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:27.054722 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:27.054726 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:27.056298 (+ 1572us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":68,"threads_started":1}
W20260812 06:24:27.056458 16123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:27.052145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:37297 (local address 127.30.15.126:37937)
0812 06:24:27.052223 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:27.052225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:27.052290 (+ 65us) server_negotiation.cc:407] Connection header received
0812 06:24:27.052366 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:27.052367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:27.052379 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:27.052445 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:27.052775 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:27.053288 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:27.054017 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:27.054209 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:27.054265 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:27.056405 (+ 2140us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:37297: BlockingRecv error: recv got EOF from 127.30.15.66:37297 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 06:24:27 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:27 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:27.176335 16126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:27.171961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:60743)
0812 06:24:27.172119 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:27.172130 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:27.172200 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:27.172329 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:27.172330 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:27.172512 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:27.172563 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:27.172566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:27.173201 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:27.173202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:27.173755 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:27.173757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:27.174094 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:27.174095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:27.174159 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:27.174546 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:27.174551 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:27.176245 (+ 1694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":83,"threads_started":1}
W20260812 06:24:27.176399 16123 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:27.172025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:60743 (local address 127.30.15.126:37937)
0812 06:24:27.172086 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:27.172088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:27.172189 (+ 101us) server_negotiation.cc:407] Connection header received
0812 06:24:27.172252 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:27.172253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:27.172266 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:27.172315 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:27.172636 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:27.173130 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:27.173833 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:27.174024 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:27.174078 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:27.176343 (+ 2265us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:60743: BlockingRecv error: recv got EOF from 127.30.15.67:60743 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 12 06:24:27 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:27 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:27.931818 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:27.927290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:60089)
0812 06:24:27.927412 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:27.927422 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:27.927471 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:27.927611 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:27.927611 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:27.927790 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:27.927840 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:27.927843 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:27.928492 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:27.928493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:27.929029 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:27.929030 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:27.929401 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:27.929402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:27.929469 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:27.929945 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:27.929953 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:27.931740 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
W20260812 06:24:27.931901 16130 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:27.927334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:60089 (local address 127.30.15.126:37937)
0812 06:24:27.927444 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:27.927446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:27.927458 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:24:27.927528 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:27.927529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:27.927540 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:27.927588 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:27.927897 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:27.928427 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:27.929111 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:27.929318 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:27.929377 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:27.931840 (+ 2463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:60089: BlockingRecv error: recv got EOF from 127.30.15.65:60089 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":55,"threads_started":1}
Aug 12 06:24:28 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:28 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:28.061161 16131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:28.056814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:53677)
0812 06:24:28.056948 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:28.056960 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:28.057058 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:28.057190 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:28.057191 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:28.057366 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:28.057424 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:28.057426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:28.058047 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:28.058048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:28.058581 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:28.058583 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:28.058855 (+ 272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:28.058856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:28.058895 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:28.059315 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:28.059320 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:28.061096 (+ 1776us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
W20260812 06:24:28.061240 16130 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:28.056865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:53677 (local address 127.30.15.126:37937)
0812 06:24:28.056932 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:28.056934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:28.057050 (+ 116us) server_negotiation.cc:407] Connection header received
0812 06:24:28.057114 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:28.057115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:28.057127 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:28.057172 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:28.057486 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:28.057986 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:28.058634 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:28.058807 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:28.058849 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:28.061180 (+ 2331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:53677: BlockingRecv error: recv got EOF from 127.30.15.66:53677 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 12 06:24:28 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:28 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:28.181181 16132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:28.176783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:43199)
0812 06:24:28.176952 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:28.176964 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:28.177030 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:28.177158 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:28.177165 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:28.177345 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:28.177395 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:28.177397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:28.178041 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:28.178042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:28.178588 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:28.178590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:28.178920 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:28.178921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:28.178990 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:28.179436 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:28.179440 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:28.181104 (+ 1664us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":88,"threads_started":1}
W20260812 06:24:28.181249 16130 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:28.176853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:43199 (local address 127.30.15.126:37937)
0812 06:24:28.176912 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:28.176915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:28.177020 (+ 105us) server_negotiation.cc:407] Connection header received
0812 06:24:28.177081 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:28.177082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:28.177097 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:28.177146 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:28.177466 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:28.177970 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:28.178664 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:28.178853 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:28.178907 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:28.181199 (+ 2292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:43199: BlockingRecv error: recv got EOF from 127.30.15.67:43199 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 12 06:24:28 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:28 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:28.936535 16138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:28.932224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:39085)
0812 06:24:28.932371 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:28.932381 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:28.932441 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:28.932567 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:28.932568 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:28.932733 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:28.932783 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:28.932784 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:28.933425 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:28.933426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:28.933973 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:28.933975 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:28.934277 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:28.934277 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:28.934319 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:28.934721 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:28.934726 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:28.936458 (+ 1732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":98,"threads_started":1}
W20260812 06:24:28.936633 16140 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:28.932290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:39085 (local address 127.30.15.126:37937)
0812 06:24:28.932397 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:28.932399 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:28.932426 (+ 27us) server_negotiation.cc:407] Connection header received
0812 06:24:28.932493 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:28.932493 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:28.932504 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:28.932560 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:28.932838 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:28.933363 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:28.934034 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:28.934223 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:28.934269 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:28.936558 (+ 2289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:39085: BlockingRecv error: recv got EOF from 127.30.15.65:39085 (error 108)
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":51,"threads_started":1}
Aug 12 06:24:29 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:29 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:29.065907 16141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:29.061547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:51223)
0812 06:24:29.061680 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:29.061690 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:29.061738 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:29.061852 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:29.061853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:29.062039 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:29.062089 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:29.062091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:29.062702 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:29.062703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:29.063248 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:29.063249 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:29.063599 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:29.063600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:29.063637 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:29.064045 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:29.064050 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:29.065847 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":57,"threads_started":1}
W20260812 06:24:29.066004 16140 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:29.061679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:51223 (local address 127.30.15.126:37937)
0812 06:24:29.061732 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:29.061734 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:29.061742 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:29.061781 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:29.061782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:29.061792 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:29.061841 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:29.062141 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:29.062638 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:29.063344 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:29.063546 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:29.063597 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:29.065947 (+ 2350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:51223: BlockingRecv error: recv got EOF from 127.30.15.66:51223 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 12 06:24:29 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:29 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:29.186158 16142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:29.181657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:42831)
0812 06:24:29.181783 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:29.181794 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:29.181854 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:29.182004 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:29.182005 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:29.182193 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:29.182257 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:29.182260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:29.182939 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:29.182940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:29.183540 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:29.183550 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:29.183847 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:29.183847 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:29.183883 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:29.184310 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:29.184315 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:29.186060 (+ 1745us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":59,"threads_started":1}
W20260812 06:24:29.186234 16140 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:29.181712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:42831 (local address 127.30.15.126:37937)
0812 06:24:29.181794 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:29.181796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:29.181852 (+ 56us) server_negotiation.cc:407] Connection header received
0812 06:24:29.181909 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:29.181910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:29.181925 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:29.181988 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:29.182331 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:29.182877 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:29.183614 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:29.183795 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:29.183845 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:29.186153 (+ 2308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:42831: BlockingRecv error: recv got EOF from 127.30.15.67:42831 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 12 06:24:29 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:29 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:29.941160 16143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:29.936937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:55201)
0812 06:24:29.937079 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:29.937089 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:29.937148 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:29.937326 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:29.937327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:29.937500 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:29.937551 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:29.937553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:29.938199 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:29.938200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:29.938731 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:29.938733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:29.939059 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:29.939059 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:29.939098 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:29.939527 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:29.939531 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:29.941103 (+ 1572us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":72,"threads_started":1}
W20260812 06:24:29.941265 16144 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:29.937004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:55201 (local address 127.30.15.126:37937)
0812 06:24:29.937116 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:29.937118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:29.937130 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:24:29.937202 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:29.937203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:29.937214 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:29.937270 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:29.937615 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:29.938128 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:29.938802 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:29.939003 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:29.939054 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:29.941192 (+ 2138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:55201: BlockingRecv error: recv got EOF from 127.30.15.65:55201 (error 108)
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":49,"threads_started":1}
Aug 12 06:24:30 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:30 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:30.074364 16146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:30.066304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:44201)
0812 06:24:30.066465 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:30.066477 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:30.066548 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:30.066674 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:30.066675 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:30.066856 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:30.066907 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:30.066910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:30.067590 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:30.067592 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:30.068150 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:30.068152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:30.068478 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:30.068479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:30.068535 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:30.072546 (+ 4011us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:30.072550 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:30.074270 (+ 1720us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":70,"threads_started":1}
W20260812 06:24:30.074421 16144 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:30.066385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:44201 (local address 127.30.15.126:37937)
0812 06:24:30.066461 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:30.066464 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:30.066526 (+ 62us) server_negotiation.cc:407] Connection header received
0812 06:24:30.066601 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:30.066602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:30.066615 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:30.066661 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:30.066980 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:30.067520 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:30.068229 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:30.068419 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:30.068473 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:30.074366 (+ 5893us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:44201: BlockingRecv error: recv got EOF from 127.30.15.66:44201 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 12 06:24:30 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:30 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.67@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:30.191098 16147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:30.186624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.67:42773)
0812 06:24:30.186763 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:30.186776 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:30.186850 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:30.186984 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:30.186985 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:30.187173 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:30.187226 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:30.187229 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:30.187904 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:30.187906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:30.188435 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:30.188436 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:30.188761 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:30.188762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:30.188822 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:30.189223 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:30.189227 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:30.191010 (+ 1783us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
W20260812 06:24:30.191180 16144 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:30.186696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:42773 (local address 127.30.15.126:37937)
0812 06:24:30.186770 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:30.186772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:30.186838 (+ 66us) server_negotiation.cc:407] Connection header received
0812 06:24:30.186909 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:30.186909 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:30.186923 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:30.186972 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:30.187336 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:30.187832 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:30.188513 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:30.188702 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:30.188756 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:30.191113 (+ 2357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.67:42773: BlockingRecv error: recv got EOF from 127.30.15.67:42773 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 06:24:30 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:30 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.65@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 06:24:30.946101 16149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:30.941637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.65:51563)
0812 06:24:30.941765 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:30.941777 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:30.941842 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:30.942035 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:30.942036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:30.942245 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:30.942304 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:30.942307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:30.942965 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:30.942966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:30.943599 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:30.943602 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:30.943890 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:30.943891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:30.943927 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:30.944308 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:30.944313 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:30.946010 (+ 1697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
W20260812 06:24:30.946177 16151 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:30.941707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:51563 (local address 127.30.15.126:37937)
0812 06:24:30.941858 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:30.941860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:30.941870 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:24:30.941902 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:30.941902 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:30.941915 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:30.941984 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:30.942377 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:30.942879 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:30.943664 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:30.943844 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:30.943886 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:30.946116 (+ 2230us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.65:51563: BlockingRecv error: recv got EOF from 127.30.15.65:51563 (error 108)
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
Aug 12 06:24:31 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 06:24:31 dist-test-slave-gjrz krb5kdc[14229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.15.66@KRBTEST.COM for oryx/127.30.15.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 06:24:31.079382 16151 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:31.074911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:58269 (local address 127.30.15.126:37937)
0812 06:24:31.074971 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:31.074973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:31.075033 (+ 60us) server_negotiation.cc:407] Connection header received
0812 06:24:31.075097 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:31.075098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:31.075108 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:31.075146 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:31.075465 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.075952 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.076681 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.076914 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.076977 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:31.079331 (+ 2354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.15.66:58269: BlockingRecv error: recv got EOF from 127.30.15.66:58269 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:24:31.079418 16153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:31.074842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:37937 (local address 127.30.15.66:58269)
0812 06:24:31.074970 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:31.074980 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:31.075039 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:31.075159 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:31.075160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:31.075357 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:31.075411 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:31.075414 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.076053 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.076054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:31.076588 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:31.076590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.076988 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.076989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:31.077055 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:31.077479 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:31.077483 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:31.079213 (+ 1730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.15.126:37937: Server oryx/127.30.15.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260812 06:24:31.122255 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 15330
I20260812 06:24:31.134773 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 15607
I20260812 06:24:31.146292 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 15822
I20260812 06:24:31.161068 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 15203
2026-08-12T06:24:31Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17594 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T06:24:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:24:31Z Disabled control of system clock
I20260812 06:24:31.191537 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:35897
--webserver_interface=127.30.15.126
--webserver_port=0
--builtin_ntp_servers=127.30.15.84:43089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:35897
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 06:24:31.270627 16157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:31.270804 16157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:31.270823 16157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:31.271919 16157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:24:31.271952 16157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:31.271965 16157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:31.271974 16157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:24:31.271984 16157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:24:31.273308 16157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:35897
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:35897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:31.273491 16157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:31.273721 16157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:31.278430 16169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:31.278455 16164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:31.278517 16157 server_base.cc:1034] running on GCE node
W20260812 06:24:31.278479 16163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:31.278785 16157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:31.279044 16157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:31.280212 16157 hybrid_clock.cc:648] HybridClock initialized: now 1786515871280191 us; error 31 us; skew 500 ppm
I20260812 06:24:31.281304 16157 webserver.cc:460] Webserver started at http://127.30.15.126:34573/ using document root <none> and password file <none>
I20260812 06:24:31.281517 16157 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:31.281565 16157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:31.281697 16157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:31.282711 16157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "ed3ea81f89bf488f844c647510daff3a"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "bdfb8feaa60bee7b13b4dd2e693b5436"
server_key_iv: "f6e8a5b9f6a657c3b86ec95ad28c5864"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.283034 16157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "ed3ea81f89bf488f844c647510daff3a"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "bdfb8feaa60bee7b13b4dd2e693b5436"
server_key_iv: "f6e8a5b9f6a657c3b86ec95ad28c5864"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.284271 16157 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:24:31.284910 16184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:31.285055 16157 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:31.285135 16157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "ed3ea81f89bf488f844c647510daff3a"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "bdfb8feaa60bee7b13b4dd2e693b5436"
server_key_iv: "f6e8a5b9f6a657c3b86ec95ad28c5864"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.285198 16157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:31.298233 16157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:31.298480 16157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:31.298597 16157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:31.302286 16157 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:35897
I20260812 06:24:31.302320 16279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:35897 every 8 connection(s)
I20260812 06:24:31.302619 16157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:24:31.303318 16282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:31.305367 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 16157
I20260812 06:24:31.305470 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:24:31.305697 30781 external_mini_cluster.cc:1428] Setting key 97d1a5c08c21c451399ef70443117e1c
I20260812 06:24:31.305931 16282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a: Bootstrap starting.
I20260812 06:24:31.306576 16282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:31.306850 16282 log.cc:824] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:31.307543 16282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a: No bootstrap required, opened a new log
I20260812 06:24:31.309571 16282 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed3ea81f89bf488f844c647510daff3a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 35897 } }
I20260812 06:24:31.309732 16282 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:31.309769 16282 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed3ea81f89bf488f844c647510daff3a, State: Initialized, Role: FOLLOWER
I20260812 06:24:31.309892 16282 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed3ea81f89bf488f844c647510daff3a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 35897 } }
I20260812 06:24:31.309970 16282 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:24:31.310000 16282 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:24:31.310091 16282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:31.310638 16282 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed3ea81f89bf488f844c647510daff3a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 35897 } }
I20260812 06:24:31.310774 16282 leader_election.cc:302] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed3ea81f89bf488f844c647510daff3a; no voters:
I20260812 06:24:31.310909 16288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:31.306172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57948 (local address 127.30.15.126:35897)
0812 06:24:31.306330 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:31.306337 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:31.306361 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:24:31.306792 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:31.306799 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:31.306856 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:31.306990 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:31.307204 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.308120 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.309167 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.309542 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.309618 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:31.310277 (+ 659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:31.310281 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:31.310281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:24:31.310434 (+ 153us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:31.310468 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:24:31.310478 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:31.310524 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:31.310626 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 06:24:31.310684 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":64,"threads_started":1}
I20260812 06:24:31.310921 16282 leader_election.cc:288] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:24:31.311314 16282 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:24:31.310968 16290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:31.312362 16290 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [term 1 LEADER]: Becoming Leader. State: Replica: ed3ea81f89bf488f844c647510daff3a, State: Running, Role: LEADER
I20260812 06:24:31.312453 16290 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed3ea81f89bf488f844c647510daff3a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 35897 } }
I20260812 06:24:31.312911 16291 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed3ea81f89bf488f844c647510daff3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed3ea81f89bf488f844c647510daff3a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 35897 } } }
I20260812 06:24:31.312793 16308 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed3ea81f89bf488f844c647510daff3a. Latest consensus state: current_term: 1 leader_uuid: "ed3ea81f89bf488f844c647510daff3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed3ea81f89bf488f844c647510daff3a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 35897 } } }
I20260812 06:24:31.313035 16291 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:31.313053 16308 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a [sys.catalog]: This master's current role is: LEADER
W20260812 06:24:31.313542 16310 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:24:31.313585 16310 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:24:31.313644 16311 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:24:31.313817 16311 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:24:31.315168 16311 catalog_manager.cc:1347] Generated new cluster ID: ec2ca2cf8e4d4b46b4cab45148532853
I20260812 06:24:31.315209 16311 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:24:31.334331 16311 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:24:31.334815 16311 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:24:31.342329 16311 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed3ea81f89bf488f844c647510daff3a: Generated new TSK 0
I20260812 06:24:31.342475 16311 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:24:31.345180 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:35897
--builtin_ntp_servers=127.30.15.84:43089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 06:24:31.425170 16319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:31.425351 16319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:31.425379 16319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:31.426465 16319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:31.426501 16319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:31.426533 16319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:24:31.427875 16319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:35897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:31.428100 16319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:31.428360 16319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:31.433040 16329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:31.433066 16330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:31.433072 16332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:31.433187 16319 server_base.cc:1034] running on GCE node
I20260812 06:24:31.433357 16319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:31.433558 16319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:31.434692 16319 hybrid_clock.cc:648] HybridClock initialized: now 1786515871434682 us; error 27 us; skew 500 ppm
I20260812 06:24:31.435851 16319 webserver.cc:460] Webserver started at http://127.30.15.65:45631/ using document root <none> and password file <none>
I20260812 06:24:31.436077 16319 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:31.436123 16319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:31.436223 16319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:31.437193 16319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "37400bc886c94392a3e1f545b6b7dcf5"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "654b6ee195e3b5d70ac28e8f9a9f15e1"
server_key_iv: "23f880c3774c6d468b1054ef7fbb422c"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.437494 16319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "37400bc886c94392a3e1f545b6b7dcf5"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "654b6ee195e3b5d70ac28e8f9a9f15e1"
server_key_iv: "23f880c3774c6d468b1054ef7fbb422c"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.438656 16319 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:24:31.439338 16348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:31.439468 16319 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:31.439543 16319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "37400bc886c94392a3e1f545b6b7dcf5"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "654b6ee195e3b5d70ac28e8f9a9f15e1"
server_key_iv: "23f880c3774c6d468b1054ef7fbb422c"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.439610 16319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:31.454267 16319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:31.454489 16319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:31.454602 16319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:31.454775 16319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:31.455075 16319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:31.455108 16319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:31.455133 16319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:31.455150 16319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:31.460633 16319 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:45181
I20260812 06:24:31.460691 16561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:45181 every 8 connection(s)
I20260812 06:24:31.460953 16319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:24:31.465449 16288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:31.461556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:38093 (local address 127.30.15.126:35897)
0812 06:24:31.461652 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:31.461655 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:31.461829 (+ 174us) server_negotiation.cc:407] Connection header received
0812 06:24:31.462293 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:31.462294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:31.462304 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:31.462355 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:31.462973 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.463516 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.464403 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.464583 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.464624 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:31.465253 (+ 629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:31.465254 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:31.465254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:24:31.465258 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:31.465273 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:24:31.465276 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:31.465316 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:31.465372 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 06:24:31.465394 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 06:24:31.465619 16566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:31.461536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:35897 (local address 127.30.15.65:38093)
0812 06:24:31.461718 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:31.461751 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:31.462213 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:31.462415 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:31.462418 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:31.462426 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:31.462908 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:31.462913 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.463580 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.463581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:31.464342 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:31.464345 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.464634 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.464634 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:31.464736 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:31.465136 (+ 400us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:24:31.465136 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:31.465161 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:24:31.465181 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:31.465320 (+ 139us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:31.465323 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:31.465325 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:24:31.465367 (+ 42us) client_negotiation.cc:240] Negotiation successful
0812 06:24:31.465440 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260812 06:24:31.466089 16562 heartbeater.cc:347] Connected to a master server at 127.30.15.126:35897
I20260812 06:24:31.466164 16562 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:31.466320 16562 heartbeater.cc:511] Master 127.30.15.126:35897 requested a full tablet report, sending...
I20260812 06:24:31.466775 16217 ts_manager.cc:194] Registered new tserver with Master: 37400bc886c94392a3e1f545b6b7dcf5 (127.30.15.65:45181)
I20260812 06:24:31.467440 16217 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.15.65:38093
I20260812 06:24:31.470438 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 16319
I20260812 06:24:31.470510 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:24:31.470680 30781 external_mini_cluster.cc:1428] Setting key 4f6144cbbfc99ffd20e8a4a5b0b53fcb
I20260812 06:24:31.471460 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:35897
--builtin_ntp_servers=127.30.15.84:43089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 06:24:31.553371 16567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:31.553548 16567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:31.553576 16567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:31.554657 16567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:31.554694 16567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:31.554725 16567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:24:31.556010 16567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:35897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:31.556218 16567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:31.556471 16567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:31.561026 16574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:31.561153 16567 server_base.cc:1034] running on GCE node
W20260812 06:24:31.561033 16579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:31.561101 16575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:31.561463 16567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:31.561708 16567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:31.562881 16567 hybrid_clock.cc:648] HybridClock initialized: now 1786515871562864 us; error 35 us; skew 500 ppm
I20260812 06:24:31.563997 16567 webserver.cc:460] Webserver started at http://127.30.15.66:42201/ using document root <none> and password file <none>
I20260812 06:24:31.564177 16567 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:31.564215 16567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:31.564301 16567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:31.565222 16567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "2ba49c4aeb134e8cbd1c433e19933de7"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "8b1fe6649835b823919f68ffef048516"
server_key_iv: "17dde56f96ff327dd602e58748c86c8c"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.565500 16567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "2ba49c4aeb134e8cbd1c433e19933de7"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "8b1fe6649835b823919f68ffef048516"
server_key_iv: "17dde56f96ff327dd602e58748c86c8c"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.566606 16567 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:24:31.567203 16589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:31.567364 16567 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:31.567445 16567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "2ba49c4aeb134e8cbd1c433e19933de7"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "8b1fe6649835b823919f68ffef048516"
server_key_iv: "17dde56f96ff327dd602e58748c86c8c"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.567512 16567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:31.583392 16567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:31.583633 16567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:31.583751 16567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:31.583935 16567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:31.584224 16567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:31.584259 16567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:31.584283 16567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:31.584299 16567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:31.589800 16567 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:46097
I20260812 06:24:31.589857 16797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:46097 every 8 connection(s)
I20260812 06:24:31.590126 16567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:24:31.594416 16288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:31.590739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:51983 (local address 127.30.15.126:35897)
0812 06:24:31.590779 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:31.590780 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:31.590983 (+ 203us) server_negotiation.cc:407] Connection header received
0812 06:24:31.591435 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:31.591437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:31.591447 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:31.591499 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:31.592079 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.592559 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.593426 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.593599 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.593641 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:31.594233 (+ 592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:31.594234 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:31.594235 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:24:31.594238 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:31.594251 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:24:31.594255 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:31.594292 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:31.594339 (+ 47us) server_negotiation.cc:299] Negotiation successful
0812 06:24:31.594361 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:24:31.594569 16801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:31.590720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:35897 (local address 127.30.15.66:51983)
0812 06:24:31.590894 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:31.590927 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:31.591360 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:31.591547 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:31.591551 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:31.591558 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:31.592014 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:31.592018 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.592617 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.592617 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:31.593370 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:31.593372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.593648 (+ 276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.593648 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:31.593741 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:31.594122 (+ 381us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:24:31.594122 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:31.594147 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:24:31.594166 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:31.594292 (+ 126us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:31.594294 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:31.594296 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:24:31.594336 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 06:24:31.594405 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260812 06:24:31.595016 16798 heartbeater.cc:347] Connected to a master server at 127.30.15.126:35897
I20260812 06:24:31.595094 16798 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:31.595255 16798 heartbeater.cc:511] Master 127.30.15.126:35897 requested a full tablet report, sending...
I20260812 06:24:31.595628 16217 ts_manager.cc:194] Registered new tserver with Master: 2ba49c4aeb134e8cbd1c433e19933de7 (127.30.15.66:46097)
I20260812 06:24:31.595981 16217 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.15.66:51983
I20260812 06:24:31.596824 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 16567
I20260812 06:24:31.596904 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:24:31.597070 30781 external_mini_cluster.cc:1428] Setting key a135cc4eb21f9209bbb542d5c52eaf3c
I20260812 06:24:31.597783 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:35897
--builtin_ntp_servers=127.30.15.84:43089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 06:24:31.677151 16803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:31.677321 16803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:31.677341 16803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:31.678439 16803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:31.678478 16803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:31.678500 16803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:24:31.679797 16803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:35897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:31.679992 16803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:31.680243 16803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:31.684862 16814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:31.684876 16813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:31.684962 16803 server_base.cc:1034] running on GCE node
W20260812 06:24:31.684847 16818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:31.685249 16803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:31.685479 16803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:31.686640 16803 hybrid_clock.cc:648] HybridClock initialized: now 1786515871686624 us; error 27 us; skew 500 ppm
I20260812 06:24:31.687902 16803 webserver.cc:460] Webserver started at http://127.30.15.67:40479/ using document root <none> and password file <none>
I20260812 06:24:31.688136 16803 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:31.688185 16803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:31.688323 16803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:31.689311 16803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "fd69a5f9f2d849d9a9ec802ab8d93ca4"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "dda1c2cf8001a416063e017c4952c9ef"
server_key_iv: "6e48d9f819249820c9265cdf1edad2e9"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.689656 16803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "fd69a5f9f2d849d9a9ec802ab8d93ca4"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "dda1c2cf8001a416063e017c4952c9ef"
server_key_iv: "6e48d9f819249820c9265cdf1edad2e9"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.690863 16803 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:24:31.691568 16832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:31.691706 16803 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:24:31.691787 16803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "fd69a5f9f2d849d9a9ec802ab8d93ca4"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "dda1c2cf8001a416063e017c4952c9ef"
server_key_iv: "6e48d9f819249820c9265cdf1edad2e9"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.691854 16803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:31.700073 16803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:31.700314 16803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:31.700433 16803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:31.700618 16803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:31.700897 16803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:31.700929 16803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:31.700956 16803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:31.700978 16803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:31.706569 16803 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:43253
I20260812 06:24:31.706604 17041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:43253 every 8 connection(s)
I20260812 06:24:31.706877 16803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:24:31.711122 16288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:31.707511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:41889 (local address 127.30.15.126:35897)
0812 06:24:31.707560 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:31.707562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:31.707761 (+ 199us) server_negotiation.cc:407] Connection header received
0812 06:24:31.708191 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:31.708193 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:31.708203 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:31.708256 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:31.708806 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.709274 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.710132 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.710315 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.710361 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:31.710957 (+ 596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:31.710957 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:31.710957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:24:31.710961 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:31.710970 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:24:31.710972 (+ 2us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:31.711003 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:31.711053 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 06:24:31.711068 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:24:31.711323 17049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:31.707502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:35897 (local address 127.30.15.67:41889)
0812 06:24:31.707663 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:31.707691 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:31.708095 (+ 404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:31.708300 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:31.708303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:31.708310 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:31.708749 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:31.708753 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.709331 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.709331 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:31.710070 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:31.710072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:31.710369 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:31.710369 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:31.710463 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:31.710859 (+ 396us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:24:31.710860 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:31.710883 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:24:31.710902 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:31.711005 (+ 103us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:31.711007 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:31.711009 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:24:31.711053 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:24:31.711121 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":79,"threads_started":1}
I20260812 06:24:31.711757 17044 heartbeater.cc:347] Connected to a master server at 127.30.15.126:35897
I20260812 06:24:31.711834 17044 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:31.712003 17044 heartbeater.cc:511] Master 127.30.15.126:35897 requested a full tablet report, sending...
I20260812 06:24:31.712301 16217 ts_manager.cc:194] Registered new tserver with Master: fd69a5f9f2d849d9a9ec802ab8d93ca4 (127.30.15.67:43253)
I20260812 06:24:31.712623 16217 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.15.67:41889
I20260812 06:24:31.712678 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 16803
I20260812 06:24:31.712761 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:24:31.712954 30781 external_mini_cluster.cc:1428] Setting key f78be8e5aa2b8e3c2c142b566378e3c5
I20260812 06:24:31.713747 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 06:24:31.715372 16288 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:31.714951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57956 (local address 127.30.15.126:35897)
0812 06:24:31.714983 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:31.714985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:31.715101 (+ 116us) server_negotiation.cc:407] Connection header received
0812 06:24:31.715141 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:31.715141 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:31.715148 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:31.715190 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:31.715317 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57956: BlockingRecv error: recv got EOF from 127.0.0.1:57956 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:24:31.715476 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 16319
I20260812 06:24:31.732750 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 16567
I20260812 06:24:31.762987 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 16803
I20260812 06:24:31.770623 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 16157
2026-08-12T06:24:31Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (610 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T06:24:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:24:31Z Disabled control of system clock
I20260812 06:24:31.801777 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:46455
--webserver_interface=127.30.15.126
--webserver_port=0
--builtin_ntp_servers=127.30.15.84:43199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:46455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 06:24:31.880076 17062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:31.880246 17062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:31.880265 17062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:31.881321 17062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:24:31.881357 17062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:31.881368 17062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:31.881379 17062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:24:31.881395 17062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:24:31.882669 17062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:46455
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:46455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:31.882843 17062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:31.883065 17062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:24:31.887446 17062 server_base.cc:1034] running on GCE node
W20260812 06:24:31.887387 17073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:31.887395 17076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:31.887379 17071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:31.887822 17062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:31.888064 17062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:31.889197 17062 hybrid_clock.cc:648] HybridClock initialized: now 1786515871889178 us; error 31 us; skew 500 ppm
I20260812 06:24:31.890458 17062 webserver.cc:460] Webserver started at http://127.30.15.126:37333/ using document root <none> and password file <none>
I20260812 06:24:31.890671 17062 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:31.890717 17062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:31.890837 17062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:31.891834 17062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "1f757961380e42548f03bd7127e04ba4"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "18ca6ad0c9400779b5f1449e638921ec"
server_key_iv: "14c917d968feedf6b10e23239a145b69"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.892151 17062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "1f757961380e42548f03bd7127e04ba4"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "18ca6ad0c9400779b5f1449e638921ec"
server_key_iv: "14c917d968feedf6b10e23239a145b69"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.893301 17062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:24:31.893913 17085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:31.894083 17062 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:31.894161 17062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "1f757961380e42548f03bd7127e04ba4"
format_stamp: "Formatted at 2026-08-12 06:24:31 on dist-test-slave-gjrz"
server_key: "18ca6ad0c9400779b5f1449e638921ec"
server_key_iv: "14c917d968feedf6b10e23239a145b69"
server_key_version: "encryptionkey@0"
I20260812 06:24:31.894225 17062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:31.897362 17062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:31.897585 17062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:31.897698 17062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:31.901281 17062 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:46455
I20260812 06:24:31.901319 17176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:46455 every 8 connection(s)
I20260812 06:24:31.901583 17062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:24:31.902181 17177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:31.904764 17177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4: Bootstrap starting.
I20260812 06:24:31.905293 17177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:31.905526 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 17062
I20260812 06:24:31.905570 17177 log.cc:824] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:31.905601 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:24:31.905774 30781 external_mini_cluster.cc:1428] Setting key 32e040fae36a2d539fdb6eb449a30bc6
I20260812 06:24:31.906251 17177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4: No bootstrap required, opened a new log
I20260812 06:24:31.908195 17177 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f757961380e42548f03bd7127e04ba4" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46455 } }
I20260812 06:24:31.908354 17177 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:31.908399 17177 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f757961380e42548f03bd7127e04ba4, State: Initialized, Role: FOLLOWER
I20260812 06:24:31.908512 17181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:31.906203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39450 (local address 127.30.15.126:46455)
0812 06:24:31.906406 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:31.906413 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:31.906436 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:24:31.907342 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:31.907349 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:31.907385 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:31.907489 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:31.908081 (+ 592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:31.908084 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:31.908084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:24:31.908088 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:31.908125 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:24:31.908134 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:31.908184 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:31.908262 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 06:24:31.908307 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":64,"threads_started":1}
I20260812 06:24:31.908533 17177 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f757961380e42548f03bd7127e04ba4" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46455 } }
I20260812 06:24:31.908605 17177 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:24:31.908640 17177 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:24:31.908684 17177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:31.909533 17177 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f757961380e42548f03bd7127e04ba4" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46455 } }
I20260812 06:24:31.909628 17177 leader_election.cc:302] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f757961380e42548f03bd7127e04ba4; no voters:
I20260812 06:24:31.909772 17177 leader_election.cc:288] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:24:31.909811 17182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:31.909955 17182 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [term 1 LEADER]: Becoming Leader. State: Replica: 1f757961380e42548f03bd7127e04ba4, State: Running, Role: LEADER
I20260812 06:24:31.910020 17177 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:24:31.910038 17182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f757961380e42548f03bd7127e04ba4" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46455 } }
I20260812 06:24:31.910389 17185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f757961380e42548f03bd7127e04ba4. Latest consensus state: current_term: 1 leader_uuid: "1f757961380e42548f03bd7127e04ba4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f757961380e42548f03bd7127e04ba4" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46455 } } }
I20260812 06:24:31.910482 17185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:31.910539 17183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f757961380e42548f03bd7127e04ba4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f757961380e42548f03bd7127e04ba4" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46455 } } }
I20260812 06:24:31.910609 17183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4 [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:31.910701 17196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:24:31.911237 17196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:24:31.915704 17196 catalog_manager.cc:1347] Generated new cluster ID: ec9b43292fcf4c5fa626071b4fc8ebec
I20260812 06:24:31.915752 17196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:24:31.950739 17196 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:24:31.950882 17196 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:24:31.954398 17196 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f757961380e42548f03bd7127e04ba4: Generated new TSK 0
I20260812 06:24:31.954548 17196 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:24:31.960171 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:46455
--builtin_ntp_servers=127.30.15.84:43199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 06:24:32.039604 17217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:32.039786 17217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:32.039806 17217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:32.040936 17217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:32.040977 17217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:32.041004 17217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:24:32.042321 17217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:46455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:32.042541 17217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:32.042793 17217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:24:32.047426 17217 server_base.cc:1034] running on GCE node
W20260812 06:24:32.047411 17226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:32.047384 17232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:32.047385 17228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:32.047816 17217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:32.048035 17217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:32.049192 17217 hybrid_clock.cc:648] HybridClock initialized: now 1786515872049175 us; error 31 us; skew 500 ppm
I20260812 06:24:32.050336 17217 webserver.cc:460] Webserver started at http://127.30.15.65:36771/ using document root <none> and password file <none>
I20260812 06:24:32.050535 17217 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:32.050588 17217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:32.050707 17217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:32.051724 17217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "dec5fda1fdac42b5964917108da1a1b0"
format_stamp: "Formatted at 2026-08-12 06:24:32 on dist-test-slave-gjrz"
server_key: "bbcea55fc026b9e923504c43a7874dea"
server_key_iv: "e167de36e53179a773e7aa21f724663d"
server_key_version: "encryptionkey@0"
I20260812 06:24:32.052035 17217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "dec5fda1fdac42b5964917108da1a1b0"
format_stamp: "Formatted at 2026-08-12 06:24:32 on dist-test-slave-gjrz"
server_key: "bbcea55fc026b9e923504c43a7874dea"
server_key_iv: "e167de36e53179a773e7aa21f724663d"
server_key_version: "encryptionkey@0"
I20260812 06:24:32.053231 17217 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:24:32.053905 17240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:32.054032 17217 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:32.054111 17217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "dec5fda1fdac42b5964917108da1a1b0"
format_stamp: "Formatted at 2026-08-12 06:24:32 on dist-test-slave-gjrz"
server_key: "bbcea55fc026b9e923504c43a7874dea"
server_key_iv: "e167de36e53179a773e7aa21f724663d"
server_key_version: "encryptionkey@0"
I20260812 06:24:32.054171 17217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:32.057392 17217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:32.057619 17217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:32.057716 17217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:32.057904 17217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:32.058179 17217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:32.058216 17217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:32.058234 17217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:32.058257 17217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:32.063858 17217 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:35065
I20260812 06:24:32.063911 17431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:35065 every 8 connection(s)
I20260812 06:24:32.064174 17217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:24:32.065358 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 17217
I20260812 06:24:32.065434 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:24:32.065640 30781 external_mini_cluster.cc:1428] Setting key 91e48f75ea0c93c3097a66698dad67c0
I20260812 06:24:32.066591 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:46455
--builtin_ntp_servers=127.30.15.84:43199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 06:24:32.067027 17181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:32.064771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:48821 (local address 127.30.15.126:46455)
0812 06:24:32.064810 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:32.064813 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:32.065047 (+ 234us) server_negotiation.cc:407] Connection header received
0812 06:24:32.065499 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:32.065501 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:32.065508 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:32.065582 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:32.066763 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:32.066764 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:32.066764 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:24:32.066769 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:32.066785 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:24:32.066789 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:32.066831 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:32.066942 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 06:24:32.066956 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:24:32.067209 17435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:32.064757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:46455 (local address 127.30.15.65:48821)
0812 06:24:32.064942 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:32.064971 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:32.065380 (+ 409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:32.065631 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:32.065634 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:32.065642 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:32.066574 (+ 932us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:24:32.066575 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:32.066601 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:24:32.066626 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:32.066842 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:32.066849 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:32.066851 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:24:32.066952 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 06:24:32.067021 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260812 06:24:32.068522 17433 heartbeater.cc:347] Connected to a master server at 127.30.15.126:46455
I20260812 06:24:32.068621 17433 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:32.068758 17433 heartbeater.cc:511] Master 127.30.15.126:46455 requested a full tablet report, sending...
I20260812 06:24:32.069212 17113 ts_manager.cc:194] Registered new tserver with Master: dec5fda1fdac42b5964917108da1a1b0 (127.30.15.65:35065)
W20260812 06:24:32.147658 17436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:32.147843 17436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:32.147873 17436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:32.149024 17436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:32.149063 17436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:32.149098 17436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:24:32.150395 17436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:46455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:32.150614 17436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:32.150866 17436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:32.155503 17449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:32.155495 17447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:32.155512 17446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:32.155582 17436 server_base.cc:1034] running on GCE node
I20260812 06:24:32.155843 17436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:32.156082 17436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:32.157234 17436 hybrid_clock.cc:648] HybridClock initialized: now 1786515872157219 us; error 29 us; skew 500 ppm
I20260812 06:24:32.158468 17436 webserver.cc:460] Webserver started at http://127.30.15.66:39783/ using document root <none> and password file <none>
I20260812 06:24:32.158672 17436 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:32.158718 17436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:32.158846 17436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:32.159963 17436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "88a2025b61c44022a488140026559290"
format_stamp: "Formatted at 2026-08-12 06:24:32 on dist-test-slave-gjrz"
server_key: "b45993a0b8e4dc4c7c247a7be271d044"
server_key_iv: "6cfab595bbaed4f463ebbdeda9c86bf6"
server_key_version: "encryptionkey@0"
I20260812 06:24:32.160362 17436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "88a2025b61c44022a488140026559290"
format_stamp: "Formatted at 2026-08-12 06:24:32 on dist-test-slave-gjrz"
server_key: "b45993a0b8e4dc4c7c247a7be271d044"
server_key_iv: "6cfab595bbaed4f463ebbdeda9c86bf6"
server_key_version: "encryptionkey@0"
I20260812 06:24:32.161610 17436 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:24:32.162324 17462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:32.162473 17436 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:32.162556 17436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "88a2025b61c44022a488140026559290"
format_stamp: "Formatted at 2026-08-12 06:24:32 on dist-test-slave-gjrz"
server_key: "b45993a0b8e4dc4c7c247a7be271d044"
server_key_iv: "6cfab595bbaed4f463ebbdeda9c86bf6"
server_key_version: "encryptionkey@0"
I20260812 06:24:32.162616 17436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:32.165809 17436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:32.166049 17436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:32.166165 17436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:32.166355 17436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:32.166626 17436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:32.166659 17436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:32.166683 17436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:32.166709 17436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:32.172176 17436 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:38375
I20260812 06:24:32.172233 17687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:38375 every 8 connection(s)
I20260812 06:24:32.172490 17436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:24:32.175071 17181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:32.173089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:34215 (local address 127.30.15.126:46455)
0812 06:24:32.173145 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:32.173147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:32.173378 (+ 231us) server_negotiation.cc:407] Connection header received
0812 06:24:32.173782 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:32.173783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:32.173788 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:32.173836 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:32.174811 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:32.174812 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:32.174813 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:24:32.174818 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:32.174836 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:24:32.174842 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:32.174902 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:32.175000 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 06:24:32.175011 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:24:32.175226 17693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:32.173090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:46455 (local address 127.30.15.66:34215)
0812 06:24:32.173265 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:32.173296 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:32.173698 (+ 402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:32.173891 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:32.173894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:32.173901 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:32.174680 (+ 779us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:24:32.174681 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:32.174705 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:24:32.174729 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:32.174918 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:32.174924 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:32.174927 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:24:32.174996 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 06:24:32.175052 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
I20260812 06:24:32.175657 17688 heartbeater.cc:347] Connected to a master server at 127.30.15.126:46455
I20260812 06:24:32.175741 17688 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:32.175848 17688 heartbeater.cc:511] Master 127.30.15.126:46455 requested a full tablet report, sending...
I20260812 06:24:32.176167 17113 ts_manager.cc:194] Registered new tserver with Master: 88a2025b61c44022a488140026559290 (127.30.15.66:38375)
I20260812 06:24:32.182019 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 17436
I20260812 06:24:32.182106 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:24:32.182250 30781 external_mini_cluster.cc:1428] Setting key 9e73b98a92cef666560e5051c85bfa6e
I20260812 06:24:32.183059 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:46455
--builtin_ntp_servers=127.30.15.84:43199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 06:24:32.262838 17694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:32.263041 17694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:32.263073 17694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:32.264251 17694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:32.264290 17694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:32.264323 17694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:24:32.265657 17694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:46455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:32.265878 17694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:32.266149 17694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:32.270780 17708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:32.270789 17704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:32.270826 17694 server_base.cc:1034] running on GCE node
W20260812 06:24:32.270792 17705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:32.271152 17694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:32.271397 17694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:32.272542 17694 hybrid_clock.cc:648] HybridClock initialized: now 1786515872272526 us; error 27 us; skew 500 ppm
I20260812 06:24:32.273660 17694 webserver.cc:460] Webserver started at http://127.30.15.67:36181/ using document root <none> and password file <none>
I20260812 06:24:32.273873 17694 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:32.273945 17694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:32.274073 17694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:32.275043 17694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "49968294c52b41fda1abda231be84b87"
format_stamp: "Formatted at 2026-08-12 06:24:32 on dist-test-slave-gjrz"
server_key: "3d8ced837dcbd583ee0e3ed686959830"
server_key_iv: "fc349e7cb5e77c9440c199c94cb58a41"
server_key_version: "encryptionkey@0"
I20260812 06:24:32.275417 17694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "49968294c52b41fda1abda231be84b87"
format_stamp: "Formatted at 2026-08-12 06:24:32 on dist-test-slave-gjrz"
server_key: "3d8ced837dcbd583ee0e3ed686959830"
server_key_iv: "fc349e7cb5e77c9440c199c94cb58a41"
server_key_version: "encryptionkey@0"
I20260812 06:24:32.276564 17694 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:24:32.277216 17716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:32.277352 17694 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:32.277431 17694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "49968294c52b41fda1abda231be84b87"
format_stamp: "Formatted at 2026-08-12 06:24:32 on dist-test-slave-gjrz"
server_key: "3d8ced837dcbd583ee0e3ed686959830"
server_key_iv: "fc349e7cb5e77c9440c199c94cb58a41"
server_key_version: "encryptionkey@0"
I20260812 06:24:32.277496 17694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:32.280629 17694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:32.280856 17694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:32.280982 17694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:32.281167 17694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:32.281432 17694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:32.281464 17694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:32.281488 17694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:32.281513 17694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:32.286985 17694 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:45369
I20260812 06:24:32.287021 17926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:45369 every 8 connection(s)
I20260812 06:24:32.287317 17694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:24:32.287771 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 17694
I20260812 06:24:32.287846 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:24:32.287984 30781 external_mini_cluster.cc:1428] Setting key 17a6c7a957e1ffa9c42414fcacbfb21a
I20260812 06:24:32.290375 17181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:32.288415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:46951 (local address 127.30.15.126:46455)
0812 06:24:32.288456 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:32.288457 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:32.288742 (+ 285us) server_negotiation.cc:407] Connection header received
0812 06:24:32.289185 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:32.289186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:32.289192 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:32.289227 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:32.290209 (+ 982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:32.290210 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:32.290210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:24:32.290214 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:32.290225 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:24:32.290228 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:32.290262 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:32.290314 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 06:24:32.290324 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:24:32.290540 17931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:32.288421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:46455 (local address 127.30.15.67:46951)
0812 06:24:32.288630 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:32.288670 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:32.289105 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:32.289280 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:32.289283 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:32.289290 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:32.290098 (+ 808us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:24:32.290098 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:32.290123 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:24:32.290148 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:32.290270 (+ 122us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:32.290273 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:32.290275 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:24:32.290319 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:24:32.290361 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":89,"threads_started":1}
I20260812 06:24:32.290917 17928 heartbeater.cc:347] Connected to a master server at 127.30.15.126:46455
I20260812 06:24:32.290992 17928 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:32.291100 17928 heartbeater.cc:511] Master 127.30.15.126:46455 requested a full tablet report, sending...
I20260812 06:24:32.291420 17113 ts_manager.cc:194] Registered new tserver with Master: 49968294c52b41fda1abda231be84b87 (127.30.15.67:45369)
I20260812 06:24:32.299511 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 06:24:32.301054 17181 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:24:32.300692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39460 (local address 127.30.15.126:46455)
0812 06:24:32.300752 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:32.300754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:32.300799 (+ 45us) server_negotiation.cc:407] Connection header received
0812 06:24:32.300846 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:32.300847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:32.300851 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:32.300891 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:32.300988 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39460: BlockingRecv error: recv got EOF from 127.0.0.1:39460 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:24:32.301102 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 17217
I20260812 06:24:32.320478 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 17436
I20260812 06:24:32.339607 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 17694
I20260812 06:24:32.356096 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 17062
2026-08-12T06:24:32Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (584 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:24:32 dist-test-slave-gjrz krb5kdc[17949](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:24:32 dist-test-slave-gjrz krb5kdc[17949](info): set up 2 sockets
Aug 12 06:24:32 dist-test-slave-gjrz krb5kdc[17949](info): commencing operation
krb5kdc: starting...
W20260812 06:24:33.564345 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:24:33 dist-test-slave-gjrz krb5kdc[17949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:24:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:24:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:24:33.674881 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:45255
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:45255
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:33.753152 17970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:33.753334 17970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:33.753353 17970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:33.754443 17970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:24:33.754482 17970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:33.754535 17970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:33.754554 17970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:24:33.754568 17970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:24:33.756047 17970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:45255
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:45255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:33.756261 17970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:33.756461 17970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:33.760921 17986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:33.760911 17982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:33.760900 17984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:33.760977 17970 server_base.cc:1034] running on GCE node
I20260812 06:24:33.761317 17970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:33.761591 17970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:33.762733 17970 hybrid_clock.cc:648] HybridClock initialized: now 1786515873762718 us; error 25 us; skew 500 ppm
Aug 12 06:24:33 dist-test-slave-gjrz krb5kdc[17949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515873, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:33.765025 17970 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:24:33.765398 17970 webserver.cc:460] Webserver started at http://127.30.15.126:38023/ using document root <none> and password file <none>
I20260812 06:24:33.765597 17970 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:33.765687 17970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:33.765800 17970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:33.766716 17970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "026d05ab052e4dc1bc71df8c62c78f4c"
format_stamp: "Formatted at 2026-08-12 06:24:33 on dist-test-slave-gjrz"
server_key: "d08c8249f313e7f7b7e429f5d67833d7"
server_key_iv: "d7684c8f7f661648af08dd1c0cbdf3a2"
server_key_version: "encryptionkey@0"
I20260812 06:24:33.766991 17970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "026d05ab052e4dc1bc71df8c62c78f4c"
format_stamp: "Formatted at 2026-08-12 06:24:33 on dist-test-slave-gjrz"
server_key: "d08c8249f313e7f7b7e429f5d67833d7"
server_key_iv: "d7684c8f7f661648af08dd1c0cbdf3a2"
server_key_version: "encryptionkey@0"
I20260812 06:24:33.768165 17970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:24:33.768774 17999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:33.768895 17970 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:24:33.768968 17970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "026d05ab052e4dc1bc71df8c62c78f4c"
format_stamp: "Formatted at 2026-08-12 06:24:33 on dist-test-slave-gjrz"
server_key: "d08c8249f313e7f7b7e429f5d67833d7"
server_key_iv: "d7684c8f7f661648af08dd1c0cbdf3a2"
server_key_version: "encryptionkey@0"
I20260812 06:24:33.769029 17970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:33.777925 17970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:33.779614 17970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:33.779726 17970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:33.783377 17970 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:45255
I20260812 06:24:33.783418 18113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:45255 every 8 connection(s)
I20260812 06:24:33.783702 17970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:24:33.784572 18114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:33.786613 18114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c: Bootstrap starting.
I20260812 06:24:33.787171 18114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:33.787467 18114 log.cc:824] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:33.788100 18114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c: No bootstrap required, opened a new log
I20260812 06:24:33.788650 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 17970
I20260812 06:24:33.788756 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:24:33.788934 30781 external_mini_cluster.cc:1428] Setting key faa6a863d939cddd9dce03dffc5219fd
I20260812 06:24:33.790114 18114 raft_consensus.cc:348] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "026d05ab052e4dc1bc71df8c62c78f4c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45255 } }
I20260812 06:24:33.790238 18114 raft_consensus.cc:374] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:33.790258 18114 raft_consensus.cc:729] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 026d05ab052e4dc1bc71df8c62c78f4c, State: Initialized, Role: FOLLOWER
I20260812 06:24:33.790362 18114 consensus_queue.cc:260] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "026d05ab052e4dc1bc71df8c62c78f4c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45255 } }
I20260812 06:24:33.790437 18114 raft_consensus.cc:388] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:24:33.790504 18114 raft_consensus.cc:482] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:24:33.790567 18114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:33.791216 18114 raft_consensus.cc:504] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "026d05ab052e4dc1bc71df8c62c78f4c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45255 } }
I20260812 06:24:33.791335 18114 leader_election.cc:302] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 026d05ab052e4dc1bc71df8c62c78f4c; no voters:
I20260812 06:24:33.791489 18114 leader_election.cc:288] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:24:33.791520 18121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:33.791677 18121 raft_consensus.cc:686] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [term 1 LEADER]: Becoming Leader. State: Replica: 026d05ab052e4dc1bc71df8c62c78f4c, State: Running, Role: LEADER
I20260812 06:24:33.791736 18114 sys_catalog.cc:564] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:24:33.791827 18121 consensus_queue.cc:237] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "026d05ab052e4dc1bc71df8c62c78f4c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45255 } }
I20260812 06:24:33.793354 18128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "026d05ab052e4dc1bc71df8c62c78f4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "026d05ab052e4dc1bc71df8c62c78f4c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45255 } } }
I20260812 06:24:33.793473 18125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 026d05ab052e4dc1bc71df8c62c78f4c. Latest consensus state: current_term: 1 leader_uuid: "026d05ab052e4dc1bc71df8c62c78f4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "026d05ab052e4dc1bc71df8c62c78f4c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45255 } } }
W20260812 06:24:33.793635 18147 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 06:24:33.794111 18128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [sys.catalog]: This master's current role is: LEADER
I20260812 06:24:33.794126 18125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c [sys.catalog]: This master's current role is: LEADER
W20260812 06:24:33.794157 18147 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:24:33.794322 18152 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:24:33.794503 18152 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 06:24:33 dist-test-slave-gjrz krb5kdc[17949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:24:33.796482 18152 catalog_manager.cc:1347] Generated new cluster ID: b523345662124774a7aa4fd91889bc0c
I20260812 06:24:33.796540 18152 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:24:33.799990 18120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:33.789394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37584 (local address 127.30.15.126:45255)
0812 06:24:33.789541 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:33.789563 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:33.789593 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:24:33.790251 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:33.790259 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:33.790321 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:33.790454 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:33.791139 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:33.792303 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:33.793316 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:33.793831 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:33.793930 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:33.796450 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:33.796454 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:33.796455 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:33.796465 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:33.798255 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:33.798597 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:33.798599 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:33.798600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:33.798689 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:33.798842 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:33.798842 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:33.798843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:33.799127 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:33.799303 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:33.799688 (+ 385us) server_negotiation.cc:299] Negotiation successful
0812 06:24:33.799810 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":67,"threads_started":1}
I20260812 06:24:33.813544 18152 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:24:33.814239 18152 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:24:33.823379 18152 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c: Generated new TSK 0
I20260812 06:24:33.823536 18152 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:24:33.849563 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45255
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:33.928925 18168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:33.929109 18168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:33.929141 18168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:33.930243 18168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:33.930281 18168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:33.930316 18168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:24:33.931795 18168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:33.932029 18168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:33.932230 18168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:33.936889 18178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:33.936939 18176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:33.936908 18175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:33.937052 18168 server_base.cc:1034] running on GCE node
I20260812 06:24:33.937278 18168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:33.937489 18168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:33.938630 18168 hybrid_clock.cc:648] HybridClock initialized: now 1786515873938619 us; error 33 us; skew 500 ppm
Aug 12 06:24:33 dist-test-slave-gjrz krb5kdc[17949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515873, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:33.940977 18168 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:24:33.941356 18168 webserver.cc:460] Webserver started at http://127.30.15.65:35073/ using document root <none> and password file <none>
I20260812 06:24:33.941560 18168 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:33.941602 18168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:33.941720 18168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:33.942662 18168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "ca5eded247654f348f04fc96902f3261"
format_stamp: "Formatted at 2026-08-12 06:24:33 on dist-test-slave-gjrz"
server_key: "b52666148cbb71a663f75d55764fa180"
server_key_iv: "b44ff3be8396be1c181c41e231cc17e7"
server_key_version: "encryptionkey@0"
I20260812 06:24:33.942974 18168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "ca5eded247654f348f04fc96902f3261"
format_stamp: "Formatted at 2026-08-12 06:24:33 on dist-test-slave-gjrz"
server_key: "b52666148cbb71a663f75d55764fa180"
server_key_iv: "b44ff3be8396be1c181c41e231cc17e7"
server_key_version: "encryptionkey@0"
I20260812 06:24:33.944278 18168 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:24:33.944905 18189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:33.945027 18168 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:33.945102 18168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "ca5eded247654f348f04fc96902f3261"
format_stamp: "Formatted at 2026-08-12 06:24:33 on dist-test-slave-gjrz"
server_key: "b52666148cbb71a663f75d55764fa180"
server_key_iv: "b44ff3be8396be1c181c41e231cc17e7"
server_key_version: "encryptionkey@0"
I20260812 06:24:33.945166 18168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:33.955993 18168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:33.957542 18168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:33.957648 18168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:33.957831 18168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:33.958086 18168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:33.958118 18168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:33.958137 18168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:33.958160 18168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:33.963758 18168 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:45679
I20260812 06:24:33.963836 18400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:45679 every 8 connection(s)
I20260812 06:24:33.964066 18168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:24:33 dist-test-slave-gjrz krb5kdc[17949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515873, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:24:33.972071 18120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:33.964666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:57757 (local address 127.30.15.126:45255)
0812 06:24:33.964708 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:33.964710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:33.964868 (+ 158us) server_negotiation.cc:407] Connection header received
0812 06:24:33.965289 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:33.965290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:33.965299 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:33.965350 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:33.966273 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:33.966770 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:33.967667 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:33.967859 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:33.967909 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:33.969673 (+ 1764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:33.969675 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:33.969675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:33.969681 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:33.970881 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:33.971251 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:33.971253 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:33.971253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:33.971359 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:33.971567 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:33.971567 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:33.971567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:33.971676 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:33.971736 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:33.971927 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 06:24:33.972009 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:24:33.972164 18403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:33.964628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:45255 (local address 127.30.15.65:57757)
0812 06:24:33.964772 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:33.964808 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:33.965219 (+ 411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:33.965398 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:33.965402 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:33.965997 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:33.966197 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:33.966203 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:33.966834 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:33.966834 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:33.967608 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:33.967610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:33.967914 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:33.967915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:33.968005 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:33.968359 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:33.968366 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:33.969596 (+ 1230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:33.970940 (+ 1344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:33.970943 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:33.970945 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:33.971130 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:33.971414 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:33.971415 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:33.971415 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:33.971521 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:33.971727 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:33.971729 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:33.971828 (+ 99us) client_negotiation.cc:769] Sending connection context
0812 06:24:33.971898 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:24:33.972010 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
I20260812 06:24:33.972587 18401 heartbeater.cc:347] Connected to a master server at 127.30.15.126:45255
I20260812 06:24:33.972676 18401 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:33.972843 18401 heartbeater.cc:511] Master 127.30.15.126:45255 requested a full tablet report, sending...
I20260812 06:24:33.973285 18042 ts_manager.cc:194] Registered new tserver with Master: ca5eded247654f348f04fc96902f3261 (127.30.15.65:45679)
I20260812 06:24:33.973822 18042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:57757
I20260812 06:24:33.974098 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 18168
I20260812 06:24:33.974200 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:24:33.974382 30781 external_mini_cluster.cc:1428] Setting key 9f0c4c3ea6915b8c49dd777f5c658baa
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:24:33.997404 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45255
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:34.077327 18409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:34.077502 18409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:34.077524 18409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:34.078619 18409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:34.078655 18409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:34.078679 18409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:24:34.080077 18409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:34.080243 18409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:34.080420 18409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:34.085028 18421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:34.085127 18419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:34.085031 18416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:34.085163 18409 server_base.cc:1034] running on GCE node
I20260812 06:24:34.085495 18409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:34.085716 18409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:34.086856 18409 hybrid_clock.cc:648] HybridClock initialized: now 1786515874086841 us; error 27 us; skew 500 ppm
Aug 12 06:24:34 dist-test-slave-gjrz krb5kdc[17949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515874, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:34.089337 18409 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:24:34.089761 18409 webserver.cc:460] Webserver started at http://127.30.15.66:33521/ using document root <none> and password file <none>
I20260812 06:24:34.090003 18409 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:34.090051 18409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:34.090171 18409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:34.091121 18409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "50f9737129424b9eaf58bfbfbb211759"
format_stamp: "Formatted at 2026-08-12 06:24:34 on dist-test-slave-gjrz"
server_key: "32d475aab6678cd7e56ac5a3c60a6c17"
server_key_iv: "c766d90b0f7c637c40c0d89bc75e4d4d"
server_key_version: "encryptionkey@0"
I20260812 06:24:34.091478 18409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "50f9737129424b9eaf58bfbfbb211759"
format_stamp: "Formatted at 2026-08-12 06:24:34 on dist-test-slave-gjrz"
server_key: "32d475aab6678cd7e56ac5a3c60a6c17"
server_key_iv: "c766d90b0f7c637c40c0d89bc75e4d4d"
server_key_version: "encryptionkey@0"
I20260812 06:24:34.092773 18409 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:24:34.093463 18438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:34.093647 18409 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:24:34.093719 18409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "50f9737129424b9eaf58bfbfbb211759"
format_stamp: "Formatted at 2026-08-12 06:24:34 on dist-test-slave-gjrz"
server_key: "32d475aab6678cd7e56ac5a3c60a6c17"
server_key_iv: "c766d90b0f7c637c40c0d89bc75e4d4d"
server_key_version: "encryptionkey@0"
I20260812 06:24:34.093783 18409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:34.116094 18409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:34.118026 18409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:34.118156 18409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:34.118381 18409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:34.118669 18409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:34.118703 18409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:34.118724 18409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:34.118747 18409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:34.124145 18409 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:41879
I20260812 06:24:34.124183 18674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:41879 every 8 connection(s)
I20260812 06:24:34.124465 18409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:24:34 dist-test-slave-gjrz krb5kdc[17949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515874, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:24:34.131920 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 18409
I20260812 06:24:34.132015 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:24:34.132233 30781 external_mini_cluster.cc:1428] Setting key 18fe5f809c4da6fdcf40ef89ec20463d
I20260812 06:24:34.132740 18120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.125133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:35677 (local address 127.30.15.126:45255)
0812 06:24:34.125191 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:34.125193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:34.125375 (+ 182us) server_negotiation.cc:407] Connection header received
0812 06:24:34.125830 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:34.125830 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:34.125840 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:34.125896 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:34.126739 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.127223 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.128186 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.128375 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.128427 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.130237 (+ 1810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:34.130238 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:34.130239 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:34.130245 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:34.131548 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:34.131903 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:34.131903 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:34.131903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:34.131949 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:34.132195 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:34.132196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:34.132196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:34.132313 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:34.132366 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:34.132613 (+ 247us) server_negotiation.cc:299] Negotiation successful
0812 06:24:34.132675 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:24:34.132946 18680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.125088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:45255 (local address 127.30.15.66:35677)
0812 06:24:34.125259 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:34.125298 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:34.125754 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:34.125956 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:34.125960 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:34.126495 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:34.126675 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.126680 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.127308 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.127309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.128111 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.128113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.128437 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.128438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.128538 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.128912 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:34.128920 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:34.130158 (+ 1238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:34.131604 (+ 1446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:34.131607 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:34.131609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:34.131836 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:34.132002 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:34.132003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:34.132003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:34.132134 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:34.132366 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:34.132374 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:34.132497 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 06:24:34.132598 (+ 101us) client_negotiation.cc:240] Negotiation successful
0812 06:24:34.132745 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260812 06:24:34.133347 18678 heartbeater.cc:347] Connected to a master server at 127.30.15.126:45255
I20260812 06:24:34.133435 18678 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:34.133638 18678 heartbeater.cc:511] Master 127.30.15.126:45255 requested a full tablet report, sending...
I20260812 06:24:34.133983 18042 ts_manager.cc:194] Registered new tserver with Master: 50f9737129424b9eaf58bfbfbb211759 (127.30.15.66:41879)
I20260812 06:24:34.134332 18042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:35677
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:24:34.155896 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45255
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:36775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:24:34.235517 18684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:24:34.235692 18684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:24:34.235713 18684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:24:34.236765 18684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:24:34.236795 18684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:24:34.236819 18684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:24:34.238173 18684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:36775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:24:34.238348 18684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:24:34.238509 18684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:24:34.243131 18699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:24:34.243126 18693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:34.243171 18684 server_base.cc:1034] running on GCE node
W20260812 06:24:34.243109 18696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:24:34.243539 18684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:24:34.243752 18684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:24:34.244886 18684 hybrid_clock.cc:648] HybridClock initialized: now 1786515874244873 us; error 27 us; skew 500 ppm
Aug 12 06:24:34 dist-test-slave-gjrz krb5kdc[17949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515874, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:24:34.247088 18684 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:24:34.247519 18684 webserver.cc:460] Webserver started at http://127.30.15.67:42581/ using document root <none> and password file <none>
I20260812 06:24:34.247721 18684 fs_manager.cc:359] Metadata directory not provided
I20260812 06:24:34.247766 18684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:24:34.247892 18684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:24:34.248838 18684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692"
format_stamp: "Formatted at 2026-08-12 06:24:34 on dist-test-slave-gjrz"
server_key: "8a569ad62efa99dc5c26d1d769ccfc33"
server_key_iv: "a59d16e6ff7c573d942a082ae936ebfc"
server_key_version: "encryptionkey@0"
I20260812 06:24:34.249197 18684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692"
format_stamp: "Formatted at 2026-08-12 06:24:34 on dist-test-slave-gjrz"
server_key: "8a569ad62efa99dc5c26d1d769ccfc33"
server_key_iv: "a59d16e6ff7c573d942a082ae936ebfc"
server_key_version: "encryptionkey@0"
I20260812 06:24:34.250427 18684 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:24:34.251031 18710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:34.251186 18684 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:24:34.251286 18684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692"
format_stamp: "Formatted at 2026-08-12 06:24:34 on dist-test-slave-gjrz"
server_key: "8a569ad62efa99dc5c26d1d769ccfc33"
server_key_iv: "a59d16e6ff7c573d942a082ae936ebfc"
server_key_version: "encryptionkey@0"
I20260812 06:24:34.251353 18684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:24:34.258261 18684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:24:34.259877 18684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:24:34.260023 18684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:24:34.260234 18684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:24:34.260543 18684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:24:34.260587 18684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:34.260623 18684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:24:34.260639 18684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:24:34.274289 18684 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:44677
I20260812 06:24:34.274348 18922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:44677 every 8 connection(s)
I20260812 06:24:34.274681 18684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:24:34 dist-test-slave-gjrz krb5kdc[17949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515874, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:24:34.281554 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 18684
I20260812 06:24:34.281649 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:24:34.281810 30781 external_mini_cluster.cc:1428] Setting key a07cb0fc04d0b3f6760cfbfd43e6d619
I20260812 06:24:34.283406 18120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.275360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:42617 (local address 127.30.15.126:45255)
0812 06:24:34.275422 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:34.275424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:34.275610 (+ 186us) server_negotiation.cc:407] Connection header received
0812 06:24:34.276095 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:34.276096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:34.276107 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:34.276158 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:34.277111 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.277599 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.278553 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.278793 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.278874 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.280816 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:34.280818 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:34.280818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:34.280824 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:34.282165 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:34.282591 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:34.282592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:34.282592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:34.282659 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:34.282873 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:34.282874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:34.282874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:34.282976 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:34.283035 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:34.283224 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 06:24:34.283317 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:24:34.283588 18927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.275342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:45255 (local address 127.30.15.67:42617)
0812 06:24:34.275501 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:34.275536 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:34.275997 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:34.276209 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:34.276212 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:34.276827 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:24:34.277038 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.277044 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.277676 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.277677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.278470 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.278473 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.278908 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.278909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.279032 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.279483 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:24:34.279491 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:24:34.280736 (+ 1245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:24:34.282243 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:34.282250 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:34.282252 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:34.282521 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:34.282719 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:24:34.282720 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:24:34.282720 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:24:34.282824 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:24:34.283033 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:24:34.283037 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:24:34.283142 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 06:24:34.283212 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:24:34.283367 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260812 06:24:34.284039 18924 heartbeater.cc:347] Connected to a master server at 127.30.15.126:45255
I20260812 06:24:34.284117 18924 heartbeater.cc:464] Registering TS with master...
I20260812 06:24:34.284273 18924 heartbeater.cc:511] Master 127.30.15.126:45255 requested a full tablet report, sending...
I20260812 06:24:34.284598 18042 ts_manager.cc:194] Registered new tserver with Master: 1b436e4d6ad8436c9d3e77ad6fc1a692 (127.30.15.67:44677)
I20260812 06:24:34.284929 18042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:42617
I20260812 06:24:34.293493 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:24:34.300094 18120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.294676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37598 (local address 127.30.15.126:45255)
0812 06:24:34.294720 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:34.294722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:34.294824 (+ 102us) server_negotiation.cc:407] Connection header received
0812 06:24:34.294865 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:34.294865 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:34.294872 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:34.294917 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:24:34.295490 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.295930 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.296674 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.296848 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.296896 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.297931 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:24:34.297932 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:24:34.297933 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:24:34.297938 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:24:34.299069 (+ 1131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:34.299393 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:34.299393 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:34.299393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:34.299436 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:24:34.299623 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:24:34.299623 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:24:34.299623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:24:34.299774 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:24:34.299868 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:34.299979 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 06:24:34.300035 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:24:34.301587 18042 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37598:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:24:34.303076 18042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:24:34.308801 18942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.305122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58462 (local address 127.30.15.67:44677)
0812 06:24:34.305347 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:34.305351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:34.305360 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:24:34.305397 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:34.305398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:34.305409 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:34.305465 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:34.305598 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.306588 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.307810 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.308424 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.308496 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.308549 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:34.308696 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 06:24:34.308733 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":77,"threads_started":1}
I20260812 06:24:34.308804 18941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.304952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:44677 (local address 127.0.0.1:58462)
0812 06:24:34.305305 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:34.305314 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:34.305354 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:34.305479 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:34.305482 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:34.305483 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:34.305529 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.305530 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.306713 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.306714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.307697 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.307700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.308505 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.308506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.308596 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.308610 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 06:24:34.308680 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:24:34.308733 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":36,"thread_start_us":65,"threads_started":1}
I20260812 06:24:34.309324 18939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.304941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:41879 (local address 127.0.0.1:41262)
0812 06:24:34.305086 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:34.305124 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:34.305183 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:34.305704 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:34.305705 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:34.305708 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:34.305758 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.305760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.307021 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.307022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.308179 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.308183 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.309067 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.309068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.309139 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.309144 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:24:34.309191 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 06:24:34.309229 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":6,"thread_start_us":60,"threads_started":1}
I20260812 06:24:34.309322 18938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.304941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:45679 (local address 127.0.0.1:41738)
0812 06:24:34.305282 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:34.305292 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:34.305347 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:34.306082 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:34.306083 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:34.306085 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:34.306131 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.306133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.306960 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.306961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.308181 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.308183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.309068 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.309069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.309139 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.309145 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 06:24:34.309202 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:24:34.309231 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":73,"thread_start_us":48,"threads_started":1}
I20260812 06:24:34.309518 18945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.305162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41738 (local address 127.30.15.65:45679)
0812 06:24:34.305847 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:34.305852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:34.305862 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:24:34.305892 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:34.305894 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:34.305909 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:34.305982 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:34.306194 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.306868 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.308268 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.308994 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.309066 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.309118 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:34.309391 (+ 273us) server_negotiation.cc:299] Negotiation successful
0812 06:24:34.309444 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":69,"threads_started":1}
I20260812 06:24:34.309574 18947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.305155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41262 (local address 127.30.15.66:41879)
0812 06:24:34.305564 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:34.305567 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:34.305573 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:24:34.305603 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:34.305604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:34.305615 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:34.305677 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:34.305929 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.306936 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.308277 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.308925 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.308986 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.309033 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:34.309436 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 06:24:34.309487 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":84,"threads_started":1}
I20260812 06:24:34.309767 18798 tablet_service.cc:1467] Processing CreateTablet for tablet 9933fdfcbc154e69aef3ec9fb9606e95 (DEFAULT_TABLE table=test-table [id=7055821e6189491186ddfd3e4ecd90ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:34.310056 18798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9933fdfcbc154e69aef3ec9fb9606e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:34.310091 18284 tablet_service.cc:1467] Processing CreateTablet for tablet 9933fdfcbc154e69aef3ec9fb9606e95 (DEFAULT_TABLE table=test-table [id=7055821e6189491186ddfd3e4ecd90ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:34.310328 18284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9933fdfcbc154e69aef3ec9fb9606e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:34.312508 18948 tablet_bootstrap.cc:492] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692: Bootstrap starting.
I20260812 06:24:34.313022 18951 tablet_bootstrap.cc:492] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261: Bootstrap starting.
I20260812 06:24:34.313083 18537 tablet_service.cc:1467] Processing CreateTablet for tablet 9933fdfcbc154e69aef3ec9fb9606e95 (DEFAULT_TABLE table=test-table [id=7055821e6189491186ddfd3e4ecd90ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:24:34.313412 18537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9933fdfcbc154e69aef3ec9fb9606e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:24:34.313486 18948 tablet_bootstrap.cc:654] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:34.313716 18951 tablet_bootstrap.cc:654] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:34.314074 18948 log.cc:824] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:34.314291 18951 log.cc:824] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:34.314940 18948 tablet_bootstrap.cc:492] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692: No bootstrap required, opened a new log
I20260812 06:24:34.315037 18948 ts_tablet_manager.cc:1397] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:24:34.315048 18951 tablet_bootstrap.cc:492] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261: No bootstrap required, opened a new log
I20260812 06:24:34.315112 18951 ts_tablet_manager.cc:1397] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:24:34.316499 18948 raft_consensus.cc:348] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca5eded247654f348f04fc96902f3261" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45679 } } peers { permanent_uuid: "50f9737129424b9eaf58bfbfbb211759" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41879 } } peers { permanent_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44677 } }
I20260812 06:24:34.316672 18948 raft_consensus.cc:374] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:34.316716 18948 raft_consensus.cc:729] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b436e4d6ad8436c9d3e77ad6fc1a692, State: Initialized, Role: FOLLOWER
I20260812 06:24:34.316833 18957 tablet_bootstrap.cc:492] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759: Bootstrap starting.
I20260812 06:24:34.316824 18948 consensus_queue.cc:260] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca5eded247654f348f04fc96902f3261" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45679 } } peers { permanent_uuid: "50f9737129424b9eaf58bfbfbb211759" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41879 } } peers { permanent_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44677 } }
I20260812 06:24:34.317098 18948 ts_tablet_manager.cc:1428] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:24:34.317098 18951 raft_consensus.cc:348] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca5eded247654f348f04fc96902f3261" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45679 } } peers { permanent_uuid: "50f9737129424b9eaf58bfbfbb211759" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41879 } } peers { permanent_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44677 } }
I20260812 06:24:34.317238 18924 heartbeater.cc:503] Master 127.30.15.126:45255 was elected leader, sending a full tablet report...
I20260812 06:24:34.317237 18951 raft_consensus.cc:374] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:34.317276 18951 raft_consensus.cc:729] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca5eded247654f348f04fc96902f3261, State: Initialized, Role: FOLLOWER
I20260812 06:24:34.317385 18951 consensus_queue.cc:260] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca5eded247654f348f04fc96902f3261" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45679 } } peers { permanent_uuid: "50f9737129424b9eaf58bfbfbb211759" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41879 } } peers { permanent_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44677 } }
I20260812 06:24:34.317499 18957 tablet_bootstrap.cc:654] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759: Neither blocks nor log segments found. Creating new log.
I20260812 06:24:34.317652 18951 ts_tablet_manager.cc:1428] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:24:34.317682 18401 heartbeater.cc:503] Master 127.30.15.126:45255 was elected leader, sending a full tablet report...
I20260812 06:24:34.318073 18957 log.cc:824] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759: Log is configured to *not* fsync() on all Append() calls
I20260812 06:24:34.318810 18957 tablet_bootstrap.cc:492] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759: No bootstrap required, opened a new log
I20260812 06:24:34.318869 18957 ts_tablet_manager.cc:1397] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:24:34.320217 18957 raft_consensus.cc:348] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca5eded247654f348f04fc96902f3261" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45679 } } peers { permanent_uuid: "50f9737129424b9eaf58bfbfbb211759" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41879 } } peers { permanent_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44677 } }
I20260812 06:24:34.320333 18957 raft_consensus.cc:374] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:24:34.320363 18957 raft_consensus.cc:729] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50f9737129424b9eaf58bfbfbb211759, State: Initialized, Role: FOLLOWER
I20260812 06:24:34.320472 18957 consensus_queue.cc:260] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca5eded247654f348f04fc96902f3261" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45679 } } peers { permanent_uuid: "50f9737129424b9eaf58bfbfbb211759" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41879 } } peers { permanent_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44677 } }
I20260812 06:24:34.320693 18957 ts_tablet_manager.cc:1428] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:24:34.320791 18678 heartbeater.cc:503] Master 127.30.15.126:45255 was elected leader, sending a full tablet report...
W20260812 06:24:34.374995 18679 tablet.cc:2369] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:24:34.464779 18402 tablet.cc:2369] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:24:34.485157 18964 raft_consensus.cc:482] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:24:34.485286 18964 raft_consensus.cc:504] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca5eded247654f348f04fc96902f3261" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45679 } } peers { permanent_uuid: "50f9737129424b9eaf58bfbfbb211759" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41879 } } peers { permanent_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44677 } }
I20260812 06:24:34.485633 18964 leader_election.cc:288] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50f9737129424b9eaf58bfbfbb211759 (127.30.15.66:41879), 1b436e4d6ad8436c9d3e77ad6fc1a692 (127.30.15.67:44677)
I20260812 06:24:34.489530 18942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.485902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:33863 (local address 127.30.15.67:44677)
0812 06:24:34.485949 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:34.485951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:34.486014 (+ 63us) server_negotiation.cc:407] Connection header received
0812 06:24:34.486076 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:34.486077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:34.486089 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:34.486138 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:34.486311 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.487062 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.488562 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.489164 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.489248 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.489257 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:34.489417 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 06:24:34.489457 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:24:34.489530 18947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.485933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:51387 (local address 127.30.15.66:41879)
0812 06:24:34.485973 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:34.485975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:34.485985 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:24:34.486050 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:34.486051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:34.486061 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:34.486125 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:24:34.486312 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.487055 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.488563 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.489164 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.489247 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.489257 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:34.489417 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 06:24:34.489460 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:24:34.489595 18971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.485787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:44677 (local address 127.30.15.65:33863)
0812 06:24:34.485924 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:34.485935 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:34.486016 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:34.486147 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:34.486148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:34.486149 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:34.486246 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.486249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.487133 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.487134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.488451 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.488456 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.489246 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.489247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.489344 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.489352 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 06:24:34.489405 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:24:34.489462 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":42,"thread_start_us":69,"threads_started":1}
I20260812 06:24:34.489598 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.485785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:41879 (local address 127.30.15.65:51387)
0812 06:24:34.485924 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:34.485935 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:24:34.485991 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:24:34.486135 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:24:34.486137 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:24:34.486139 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:24:34.486252 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.486254 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.487133 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.487133 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.488452 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:24:34.488456 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.489249 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.489249 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:24:34.489344 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.489351 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 06:24:34.489405 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:24:34.489462 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":103,"thread_start_us":67,"threads_started":1}
I20260812 06:24:34.489957 18838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9933fdfcbc154e69aef3ec9fb9606e95" candidate_uuid: "ca5eded247654f348f04fc96902f3261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692" is_pre_election: true
I20260812 06:24:34.490001 18579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9933fdfcbc154e69aef3ec9fb9606e95" candidate_uuid: "ca5eded247654f348f04fc96902f3261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f9737129424b9eaf58bfbfbb211759" is_pre_election: true
I20260812 06:24:34.490127 18838 raft_consensus.cc:2454] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca5eded247654f348f04fc96902f3261 in term 0.
I20260812 06:24:34.490141 18579 raft_consensus.cc:2454] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca5eded247654f348f04fc96902f3261 in term 0.
I20260812 06:24:34.490386 18196 leader_election.cc:302] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b436e4d6ad8436c9d3e77ad6fc1a692, ca5eded247654f348f04fc96902f3261; no voters:
I20260812 06:24:34.490552 18964 raft_consensus.cc:2781] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:24:34.490593 18964 raft_consensus.cc:482] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:24:34.490609 18964 raft_consensus.cc:3037] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:34.491467 18964 raft_consensus.cc:504] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca5eded247654f348f04fc96902f3261" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45679 } } peers { permanent_uuid: "50f9737129424b9eaf58bfbfbb211759" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41879 } } peers { permanent_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44677 } }
I20260812 06:24:34.491590 18964 leader_election.cc:288] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [CANDIDATE]: Term 1 election: Requested vote from peers 50f9737129424b9eaf58bfbfbb211759 (127.30.15.66:41879), 1b436e4d6ad8436c9d3e77ad6fc1a692 (127.30.15.67:44677)
I20260812 06:24:34.491784 18838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9933fdfcbc154e69aef3ec9fb9606e95" candidate_uuid: "ca5eded247654f348f04fc96902f3261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692"
I20260812 06:24:34.491783 18579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9933fdfcbc154e69aef3ec9fb9606e95" candidate_uuid: "ca5eded247654f348f04fc96902f3261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50f9737129424b9eaf58bfbfbb211759"
I20260812 06:24:34.491865 18579 raft_consensus.cc:3037] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:34.491865 18838 raft_consensus.cc:3037] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:24:34.492794 18838 raft_consensus.cc:2454] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca5eded247654f348f04fc96902f3261 in term 1.
I20260812 06:24:34.492915 18579 raft_consensus.cc:2454] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca5eded247654f348f04fc96902f3261 in term 1.
I20260812 06:24:34.492962 18196 leader_election.cc:302] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b436e4d6ad8436c9d3e77ad6fc1a692, ca5eded247654f348f04fc96902f3261; no voters:
I20260812 06:24:34.493096 18964 raft_consensus.cc:2781] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:24:34.493221 18964 raft_consensus.cc:686] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 1 LEADER]: Becoming Leader. State: Replica: ca5eded247654f348f04fc96902f3261, State: Running, Role: LEADER
I20260812 06:24:34.493295 18964 consensus_queue.cc:237] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca5eded247654f348f04fc96902f3261" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45679 } } peers { permanent_uuid: "50f9737129424b9eaf58bfbfbb211759" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41879 } } peers { permanent_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44677 } }
I20260812 06:24:34.494124 18039 catalog_manager.cc:5495] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca5eded247654f348f04fc96902f3261 (127.30.15.65). New cstate: current_term: 1 leader_uuid: "ca5eded247654f348f04fc96902f3261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca5eded247654f348f04fc96902f3261" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50f9737129424b9eaf58bfbfbb211759" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44677 } health_report { overall_health: UNKNOWN } } }
W20260812 06:24:34.525219 18926 tablet.cc:2369] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:24:34.532356 18945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.530139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41746 (local address 127.30.15.65:45679)
0812 06:24:34.530186 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:24:34.530188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:24:34.530196 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:24:34.530243 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:24:34.530244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:24:34.530262 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:24:34.530323 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:24:34.530444 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.530912 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.531671 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:24:34.531865 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:24:34.531920 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:24:34.532071 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:24:34.532164 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:24:34.532233 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:24:34.532273 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 06:24:34.532292 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:24:34.533903 18579 raft_consensus.cc:1261] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759 [term 1 FOLLOWER]: Refusing update from remote peer ca5eded247654f348f04fc96902f3261: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:34.533934 18838 raft_consensus.cc:1261] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692 [term 1 FOLLOWER]: Refusing update from remote peer ca5eded247654f348f04fc96902f3261: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:24:34.534212 18973 consensus_queue.cc:1035] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50f9737129424b9eaf58bfbfbb211759" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 41879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:34.534335 18964 consensus_queue.cc:1035] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b436e4d6ad8436c9d3e77ad6fc1a692" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:24:34.536387 18977 mvcc.cc:205] Tried to move back new op lower bound from 7317569022088736768 to 7317569021925072896. Current Snapshot: MvccSnapshot[applied={T|T < 7317569022088736768}]
I20260812 06:24:34.537618 18981 mvcc.cc:205] Tried to move back new op lower bound from 7317569022088736768 to 7317569021925072896. Current Snapshot: MvccSnapshot[applied={T|T < 7317569022088736768 or (T in {7317569022088736768})}]
I20260812 06:24:34.538895 18042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:34.538977 18042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37598:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:24:34.539606 18042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 026d05ab052e4dc1bc71df8c62c78f4c: Sending DeleteTablet for 3 replicas of tablet 9933fdfcbc154e69aef3ec9fb9606e95
I20260812 06:24:34.539919 18284 tablet_service.cc:1514] Processing DeleteTablet for tablet 9933fdfcbc154e69aef3ec9fb9606e95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:34 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:41738
I20260812 06:24:34.540021 18798 tablet_service.cc:1514] Processing DeleteTablet for tablet 9933fdfcbc154e69aef3ec9fb9606e95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:34 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:58462
I20260812 06:24:34.540162 18993 tablet_replica.cc:330] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261: stopping tablet replica
I20260812 06:24:34.540149 18537 tablet_service.cc:1514] Processing DeleteTablet for tablet 9933fdfcbc154e69aef3ec9fb9606e95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:24:34 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:41262
I20260812 06:24:34.540270 18993 raft_consensus.cc:2229] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:24:34.540390 18993 raft_consensus.cc:2258] T 9933fdfcbc154e69aef3ec9fb9606e95 P ca5eded247654f348f04fc96902f3261 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:34.540382 18995 tablet_replica.cc:330] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759: stopping tablet replica
I20260812 06:24:34.540549 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 18168
I20260812 06:24:34.540663 18995 raft_consensus.cc:2229] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:34.540791 18995 raft_consensus.cc:2258] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:34.541435 18995 ts_tablet_manager.cc:1905] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:34.544037 18995 ts_tablet_manager.cc:1918] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:24:34.544108 18995 log.cc:1196] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/9933fdfcbc154e69aef3ec9fb9606e95
I20260812 06:24:34.544319 18995 ts_tablet_manager.cc:1939] T 9933fdfcbc154e69aef3ec9fb9606e95 P 50f9737129424b9eaf58bfbfbb211759: Deleting consensus metadata
I20260812 06:24:34.544629 18006 catalog_manager.cc:4841] TS 50f9737129424b9eaf58bfbfbb211759 (127.30.15.66:41879): tablet 9933fdfcbc154e69aef3ec9fb9606e95 (table test-table [id=7055821e6189491186ddfd3e4ecd90ad]) successfully deleted
I20260812 06:24:34.550014 18994 tablet_replica.cc:330] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692: stopping tablet replica
I20260812 06:24:34.550173 18994 raft_consensus.cc:2229] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:24:34.550277 18994 raft_consensus.cc:2258] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:24:34.550642 18994 ts_tablet_manager.cc:1905] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:24:34.551862 18994 ts_tablet_manager.cc:1918] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:24:34.551927 18994 log.cc:1196] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/9933fdfcbc154e69aef3ec9fb9606e95
I20260812 06:24:34.552138 18994 ts_tablet_manager.cc:1939] T 9933fdfcbc154e69aef3ec9fb9606e95 P 1b436e4d6ad8436c9d3e77ad6fc1a692: Deleting consensus metadata
I20260812 06:24:34.552487 18009 catalog_manager.cc:4841] TS 1b436e4d6ad8436c9d3e77ad6fc1a692 (127.30.15.67:44677): tablet 9933fdfcbc154e69aef3ec9fb9606e95 (table test-table [id=7055821e6189491186ddfd3e4ecd90ad]) successfully deleted
W20260812 06:24:34.554754 18000 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:45679 (error 108)
I20260812 06:24:34.554953 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 18409
I20260812 06:24:34.556669 18938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:24:34.555120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:45679 (local address 127.0.0.1:41748)
0812 06:24:34.556595 (+ 1475us) negotiation.cc:107] Waiting for socket to connect
0812 06:24:34.556639 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:45679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1452}
W20260812 06:24:34.556794 18000 catalog_manager.cc:4584] TS ca5eded247654f348f04fc96902f3261 (127.30.15.65:45679): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9933fdfcbc154e69aef3ec9fb9606e95: Network error: Client connection negotiation failed: client connection to 127.30.15.65:45679: connect: Connection refused (error 111)
I20260812 06:24:34.564831 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 18684
I20260812 06:24:34.578969 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 17970
2026-08-12T06:24:34Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2220 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:24:34 dist-test-slave-gjrz krb5kdc[19001](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:24:34 dist-test-slave-gjrz krb5kdc[19001](info): set up 2 sockets
Aug 12 06:24:34 dist-test-slave-gjrz krb5kdc[19001](info): commencing operation
krb5kdc: starting...
W20260812 06:24:35.782056 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:24:35 dist-test-slave-gjrz krb5kdc[19001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:24:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:24:35Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.30.15.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.30.15.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/rangeradmin_127.30.15.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/rangeradmin_127.30.15.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.30.15.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.30.15.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/rangerlookup_127.30.15.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/rangerlookup_127.30.15.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.15.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.30.15.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/HTTP_127.30.15.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/HTTP_127.30.15.84@KRBTEST.COM.keytab.
I20260812 06:24:35.929932 30781 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskS3BRRW/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/postgres -l logfile start
2026-08-12 06:24:38.109 UTC [19054] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 06:24:38.109 UTC [19054] LOG: listening on IPv4 address "127.30.15.84", port 43827
2026-08-12 06:24:38.112 UTC [19054] LOG: listening on Unix socket "/tmp/.s.PGSQL.43827"
2026-08-12 06:24:38.140 UTC [19059] LOG: database system was shut down at 2026-08-12 06:24:36 UTC
2026-08-12 06:24:38.143 UTC [19054] LOG: database system is ready to accept connections
I20260812 06:24:39.246703 30781 mini_postgres.cc:96] Postgres bound to 43827
2026-08-12 06:24:39.253 UTC [19075] FATAL: database "slave" does not exist
127.30.15.84:43827 - accepting connections
I20260812 06:24:39.254096 30781 mini_ranger.cc:161] Starting Ranger...
I20260812 06:24:39.268055 30781 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 06:24:39.681521 30781 mini_ranger.cc:87] Created ranger Postgres database
I20260812 06:24:39.681588 30781 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-admin
2026-08-12 06:24:39,971 [I] DB FLAVOR :POSTGRES
2026-08-12 06:24:39,971 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:24:39,971 [I] Checking connection..
2026-08-12 06:24:39,971 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 06:24:40,228 [I] Checking connection passed.
2026-08-12 06:24:40,228 [I] --------- Verifying version history table ---------
2026-08-12 06:24:40,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:24:40,483 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:24:40,484 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:24:40,723 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:24:40,724 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 06:24:40,724 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 06:24:40.963 UTC [19186] WARNING: there is no transaction in progress
2026-08-12 06:24:40,970 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 06:24:40,971 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:24:41,211 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 06:24:41,211 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:24:41,211 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 06:24:41,458 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 06:24:41,716 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gjrz.c.gcp-upstream.internal','N') ;"
2026-08-12 06:24:41,947 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:24:42,202 [I] Table x_portal_user does not exist in database ranger
2026-08-12 06:24:42,202 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:24:42,457 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 06:24:42,457 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:24:42,695 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:24:42,949 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 06:24:42,950 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 06:24:43.842 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:43.856 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:43.871 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:43.885 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:43.900 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:43.917 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:43.967 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:43.973 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:43.985 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:43.994 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:44.003 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:44.016 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:44.024 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:44.029 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:44.035 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:44.041 UTC [19390] WARNING: there is no transaction in progress
2026-08-12 06:24:44,599 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 06:24:44,599 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 06:24:44,826 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 06:24:44,827 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:24:45,067 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 06:24:45,067 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:24:45,323 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 06:24:45,323 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:24:45,572 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:24:45,822 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gjrz.c.gcp-upstream.internal';"
2026-08-12 06:24:46,049 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 06:24:46,049 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 06:24:46,303 [I] DB_PATCHES have already been applied
I20260812 06:24:46.308799 30781 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-admin:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskS3BRRW/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 06:24:46.308856 30781 mini_ranger.cc:193] Using host: 127.30.15.84
I20260812 06:24:46.312505 30781 mini_ranger.cc:227] Ranger admin URL: http://127.30.15.84:46543
Aug 12, 2026 6:24:46 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:24:46 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:24:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 6:24:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 6:24:46 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 6:24:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 6:24:47 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 06:24:47.598421 30781 mini_ranger.cc:160] Time spent starting Ranger: real 8.344s user 0.003s sys 0.006s
Aug 12, 2026 6:25:07 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 6:25:07 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 12, 2026 6:25:07 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 6:25:07 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 6:25:07 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 6:25:08 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 06:25:08.811980 30781 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.30.15.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.30.15.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/rangerkms_127.30.15.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/rangerkms_127.30.15.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.15.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.30.15.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.15.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/HTTP_127.30.15.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.15.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/HTTP_127.30.15.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 06:25:08 dist-test-slave-gjrz krb5kdc[19001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515908, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 06:25:08.901587 30781 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 06:25:08.910830 30781 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 06:25:09.623193 30781 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 06:25:09.623284 30781 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-kms
I20260812 06:25:09.623304 30781 mini_ranger_kms.cc:227] Using postgres at 127.30.15.84:43827
2026-08-12 06:25:09,791 [I] DB FLAVOR :POSTGRES
2026-08-12 06:25:09,792 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:25:09,792 [I] Checking connection
2026-08-12 06:25:09,792 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 06:25:10,023 [I] connection success
2026-08-12 06:25:10,023 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 06:25:10,023 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 06:25:10,024 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 06:25:10,258 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 06:25:10,258 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:25:10,258 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 06:25:10,258 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:43827/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 06:25:10,519 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 06:25:10.972023 30781 mini_ranger_kms.cc:310] Created kms service
I20260812 06:25:11.199067 30781 mini_ranger_kms.cc:326] Created kudu user
I20260812 06:25:11.244095 30781 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 06:25:11 dist-test-slave-gjrz krb5kdc[19001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515908, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:25:11.611438 30781 mini_ranger_kms.cc:384] Added ranger policy
I20260812 06:25:11.611546 30781 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-kms:/tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 06:25:11.611567 30781 mini_ranger_kms.cc:240] Using host: 127.30.15.84
I20260812 06:25:11.616214 30781 mini_ranger_kms.cc:276] Ranger KMS PID: 19756
I20260812 06:25:11.616302 30781 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.30.15.84:57277
Aug 12, 2026 6:25:12 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:25:12 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:25:12 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 6:25:12 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 6:25:13 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 6:25:13 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 06:25:13 dist-test-slave-gjrz krb5kdc[19001](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515913, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.15.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 06:25:14 dist-test-slave-gjrz krb5kdc[19001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515913, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.15.84@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:25:14.258339 30781 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.357s user 0.000s sys 0.153s
I20260812 06:25:14.258438 30781 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 06:25:14.258517 30781 mini_ranger_kms.cc:401] 127.30.15.84:57277/kms/v1/keys
Aug 12 06:25:14 dist-test-slave-gjrz krb5kdc[19001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515913, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.15.84@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
Aug 12 06:25:16 dist-test-slave-gjrz krb5kdc[19001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:25:16.801831 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:38143
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:33149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:38143
--ranger_config_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.15.84:57277/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:25:16.881968 19859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:25:16.882151 19859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:25:16.882170 19859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:25:16.883291 19859 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:25:16.883327 19859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:25:16.883342 19859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:25:16.883352 19859 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:25:16.883364 19859 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:25:16.884917 19859 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:33149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/wal
--ranger_kms_url=127.30.15.84:57277/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:38143
--ranger_config_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:38143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:25:16.885133 19859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:25:16.885335 19859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:25:16.890254 19866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:25:16.890276 19859 server_base.cc:1034] running on GCE node
W20260812 06:25:16.890261 19872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:25:16.890372 19868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:25:16.890801 19859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:25:16.891134 19859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:25:16.892306 19859 hybrid_clock.cc:648] HybridClock initialized: now 1786515916892288 us; error 33 us; skew 500 ppm
Aug 12 06:25:16 dist-test-slave-gjrz krb5kdc[19001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515916, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:25:16.898504 19859 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:25:16.899008 19859 webserver.cc:460] Webserver started at http://127.30.15.126:38171/ using document root <none> and password file <none>
I20260812 06:25:16.899251 19859 fs_manager.cc:359] Metadata directory not provided
I20260812 06:25:16.899325 19859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:25:16.899462 19859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:25:16 dist-test-slave-gjrz krb5kdc[19001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515916, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:25:16.946506 19859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "f870c5ac84f5429db627c9178bbfda57"
format_stamp: "Formatted at 2026-08-12 06:25:16 on dist-test-slave-gjrz"
server_key: "c337cef5af32900fbd0835aab8fa4718"
server_key_iv: "4600089f17e11cd7867304661a488bae"
server_key_version: "kuduclusterkey@0"
I20260812 06:25:16.946950 19859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "f870c5ac84f5429db627c9178bbfda57"
format_stamp: "Formatted at 2026-08-12 06:25:16 on dist-test-slave-gjrz"
server_key: "c337cef5af32900fbd0835aab8fa4718"
server_key_iv: "4600089f17e11cd7867304661a488bae"
server_key_version: "kuduclusterkey@0"
I20260812 06:25:16.948671 19859 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260812 06:25:16.962781 19886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:25:16.962980 19859 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:25:16.963097 19859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "f870c5ac84f5429db627c9178bbfda57"
format_stamp: "Formatted at 2026-08-12 06:25:16 on dist-test-slave-gjrz"
server_key: "c337cef5af32900fbd0835aab8fa4718"
server_key_iv: "4600089f17e11cd7867304661a488bae"
server_key_version: "kuduclusterkey@0"
I20260812 06:25:16.963198 19859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:25:16.975389 19859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:25:16.977160 19859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:25:16.977291 19859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:25:16.982879 19859 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:38143
I20260812 06:25:16.982908 19972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:38143 every 8 connection(s)
I20260812 06:25:16.983242 19859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:25:16.983930 19975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:25:16.986176 19975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57: Bootstrap starting.
I20260812 06:25:16.986730 19975 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57: Neither blocks nor log segments found. Creating new log.
I20260812 06:25:16.986996 19975 log.cc:824] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57: Log is configured to *not* fsync() on all Append() calls
I20260812 06:25:16.987360 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 19859
I20260812 06:25:16.987476 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:25:16.987670 30781 external_mini_cluster.cc:1428] Setting key e91de4df8518ba2597221f8092d06d32
I20260812 06:25:16.987753 19975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57: No bootstrap required, opened a new log
I20260812 06:25:16.990547 19975 raft_consensus.cc:348] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f870c5ac84f5429db627c9178bbfda57" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38143 } }
I20260812 06:25:16.990681 19975 raft_consensus.cc:374] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:25:16.990712 19975 raft_consensus.cc:729] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f870c5ac84f5429db627c9178bbfda57, State: Initialized, Role: FOLLOWER
I20260812 06:25:16.990866 19975 consensus_queue.cc:260] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f870c5ac84f5429db627c9178bbfda57" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38143 } }
I20260812 06:25:16.990936 19975 raft_consensus.cc:388] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:25:16.990967 19975 raft_consensus.cc:482] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:25:16.991026 19975 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:25:16.991591 19975 raft_consensus.cc:504] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f870c5ac84f5429db627c9178bbfda57" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38143 } }
I20260812 06:25:16.991689 19975 leader_election.cc:302] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f870c5ac84f5429db627c9178bbfda57; no voters:
I20260812 06:25:16.991874 19975 leader_election.cc:288] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:25:16.991914 19984 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:25:16.992121 19984 raft_consensus.cc:686] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [term 1 LEADER]: Becoming Leader. State: Replica: f870c5ac84f5429db627c9178bbfda57, State: Running, Role: LEADER
I20260812 06:25:16.992167 19975 sys_catalog.cc:564] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:25:16.992316 19984 consensus_queue.cc:237] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f870c5ac84f5429db627c9178bbfda57" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38143 } }
I20260812 06:25:16.992818 19984 sys_catalog.cc:455] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f870c5ac84f5429db627c9178bbfda57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f870c5ac84f5429db627c9178bbfda57" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38143 } } }
I20260812 06:25:16.992971 19984 sys_catalog.cc:458] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [sys.catalog]: This master's current role is: LEADER
I20260812 06:25:16.993148 19984 sys_catalog.cc:455] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f870c5ac84f5429db627c9178bbfda57. Latest consensus state: current_term: 1 leader_uuid: "f870c5ac84f5429db627c9178bbfda57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f870c5ac84f5429db627c9178bbfda57" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38143 } } }
I20260812 06:25:16.993263 19984 sys_catalog.cc:458] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57 [sys.catalog]: This master's current role is: LEADER
I20260812 06:25:16.993430 19997 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:25:16.993680 19975 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 06:25:16.994022 19997 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:25:16.995167 20009 mvcc.cc:205] Tried to move back new op lower bound from 7317569196010639360 to 7317569196001124352. Current Snapshot: MvccSnapshot[applied={T|T < 7317569196010639360}]
Aug 12 06:25:16 dist-test-slave-gjrz krb5kdc[19001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:25:16.997509 19997 catalog_manager.cc:1347] Generated new cluster ID: 10d740f85e374af5b7dcbf2f25d5fada
I20260812 06:25:16.997623 19997 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:25:17.007601 19981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:16.988324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53574 (local address 127.30.15.126:38143)
0812 06:25:16.988531 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 06:25:16.988541 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:25:16.988576 (+ 35us) server_negotiation.cc:407] Connection header received
0812 06:25:16.989174 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:25:16.989184 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:25:16.989247 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:25:16.989386 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:25:16.990159 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:16.991664 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:16.992793 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:16.993407 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:16.996275 (+ 2868us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:16.996389 (+ 114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:25:16.996393 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:25:16.996393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:25:16.996401 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:25:17.004606 (+ 8205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:25:17.005122 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:25:17.005130 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:25:17.005130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:25:17.005296 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:25:17.005547 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:25:17.005549 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:25:17.005549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:25:17.006031 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:25:17.006715 (+ 684us) server_negotiation.cc:1035] Waiting for connection context
0812 06:25:17.006801 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 06:25:17.007239 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":79,"threads_started":1}
I20260812 06:25:17.020547 19997 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:25:17.021309 19997 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:25:17.027968 19997 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57: Generated new TSK 0
I20260812 06:25:17.028190 19997 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:25:17.736213 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.15.84:57277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38143
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:33149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:25:17.822180 20050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:25:17.822360 20050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:25:17.822391 20050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:25:17.823513 20050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:25:17.823553 20050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:25:17.823588 20050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:25:17.825112 20050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:33149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.30.15.84:57277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:25:17.825322 20050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:25:17.825518 20050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:25:17.830246 20058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:25:17.830238 20059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:25:17.830436 20050 server_base.cc:1034] running on GCE node
W20260812 06:25:17.830566 20063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:25:17.830734 20050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:25:17.830958 20050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:25:17.832100 20050 hybrid_clock.cc:648] HybridClock initialized: now 1786515917832087 us; error 31 us; skew 500 ppm
Aug 12 06:25:17 dist-test-slave-gjrz krb5kdc[19001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515917, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:25:17.834723 20050 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:25:17.835243 20050 webserver.cc:460] Webserver started at http://127.30.15.65:38955/ using document root <none> and password file <none>
I20260812 06:25:17.835515 20050 fs_manager.cc:359] Metadata directory not provided
I20260812 06:25:17.835585 20050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:25:17.835721 20050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:25:17 dist-test-slave-gjrz krb5kdc[19001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515917, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:25:17.849251 20050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "3dc293c4c31e43ea896f591b16ce5ecc"
format_stamp: "Formatted at 2026-08-12 06:25:17 on dist-test-slave-gjrz"
server_key: "1371d38de78b29039a66a4e331236501"
server_key_iv: "8827981474326568834dec0e63238539"
server_key_version: "kuduclusterkey@0"
I20260812 06:25:17.849670 20050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "3dc293c4c31e43ea896f591b16ce5ecc"
format_stamp: "Formatted at 2026-08-12 06:25:17 on dist-test-slave-gjrz"
server_key: "1371d38de78b29039a66a4e331236501"
server_key_iv: "8827981474326568834dec0e63238539"
server_key_version: "kuduclusterkey@0"
I20260812 06:25:17.857908 20050 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.001s sys 0.002s
I20260812 06:25:17.872233 20076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:25:17.872398 20050 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:25:17.872493 20050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "3dc293c4c31e43ea896f591b16ce5ecc"
format_stamp: "Formatted at 2026-08-12 06:25:17 on dist-test-slave-gjrz"
server_key: "1371d38de78b29039a66a4e331236501"
server_key_iv: "8827981474326568834dec0e63238539"
server_key_version: "kuduclusterkey@0"
I20260812 06:25:17.872570 20050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:25:17.901247 20050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:25:17.903693 20050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:25:17.903859 20050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:25:17.904132 20050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:25:17.904520 20050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:25:17.904572 20050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:25:17.904603 20050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:25:17.904659 20050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:25:17.914614 20050 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:44179
I20260812 06:25:17.914697 20282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:44179 every 8 connection(s)
I20260812 06:25:17.915189 20050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:25:17 dist-test-slave-gjrz krb5kdc[19001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515917, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:25:17.925426 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 20050
I20260812 06:25:17.925519 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:25:17.925709 30781 external_mini_cluster.cc:1428] Setting key 395bf9a7cda10329b04c8ec91b094f2b
I20260812 06:25:17.926599 20290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:17.915905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:38143 (local address 127.30.15.65:36243)
0812 06:25:17.916107 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0812 06:25:17.916151 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 06:25:17.916979 (+ 828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:25:17.917346 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:25:17.917350 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:25:17.917597 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:25:17.917864 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:17.917871 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:17.918872 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:17.918874 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:17.920163 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:17.920167 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:17.920675 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:17.920676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:17.920818 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:17.921338 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:25:17.921348 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:25:17.922983 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:25:17.924965 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:25:17.924972 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:25:17.924974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:25:17.925258 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:25:17.925493 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:25:17.925494 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:25:17.925494 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:25:17.925629 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:25:17.925944 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:25:17.925951 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:25:17.926125 (+ 174us) client_negotiation.cc:769] Sending connection context
0812 06:25:17.926232 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 06:25:17.926377 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":104,"threads_started":1}
I20260812 06:25:17.927029 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:17.916222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:36243 (local address 127.30.15.126:38143)
0812 06:25:17.916422 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 06:25:17.916424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:25:17.916436 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:25:17.917155 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:25:17.917157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:25:17.917172 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:25:17.917229 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:25:17.917980 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:17.918761 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:17.920265 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:17.920572 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:17.920658 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:17.923092 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:25:17.923094 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:25:17.923094 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:25:17.923101 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:25:17.924854 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:25:17.925345 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:25:17.925346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:25:17.925347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:25:17.925420 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:25:17.925708 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:25:17.925709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:25:17.925709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:25:17.925850 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:25:17.925913 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:25:17.926843 (+ 930us) server_negotiation.cc:299] Negotiation successful
0812 06:25:17.926935 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":136,"threads_started":1}
I20260812 06:25:17.930338 20285 heartbeater.cc:347] Connected to a master server at 127.30.15.126:38143
I20260812 06:25:17.930502 20285 heartbeater.cc:464] Registering TS with master...
I20260812 06:25:17.930735 20285 heartbeater.cc:511] Master 127.30.15.126:38143 requested a full tablet report, sending...
I20260812 06:25:17.931361 19918 ts_manager.cc:194] Registered new tserver with Master: 3dc293c4c31e43ea896f591b16ce5ecc (127.30.15.65:44179)
I20260812 06:25:17.932247 19918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:36243
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:25:17.964227 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.15.84:57277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38143
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:33149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:25:18.086360 20299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:25:18.086704 20299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:25:18.086786 20299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:25:18.088637 20299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:25:18.088760 20299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:25:18.088842 20299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:25:18.090977 20299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:33149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.30.15.84:57277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:25:18.091560 20299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:25:18.091900 20299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:25:18.099124 20324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:25:18.099725 20320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:25:18.100750 20299 server_base.cc:1034] running on GCE node
W20260812 06:25:18.103405 20322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:25:18.103722 20299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:25:18.103997 20299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:25:18.105170 20299 hybrid_clock.cc:648] HybridClock initialized: now 1786515918105144 us; error 40 us; skew 500 ppm
Aug 12 06:25:18 dist-test-slave-gjrz krb5kdc[19001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515918, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:25:18.108541 20299 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:25:18.109061 20299 webserver.cc:460] Webserver started at http://127.30.15.66:44941/ using document root <none> and password file <none>
I20260812 06:25:18.109329 20299 fs_manager.cc:359] Metadata directory not provided
I20260812 06:25:18.109388 20299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:25:18.109522 20299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:25:18 dist-test-slave-gjrz krb5kdc[19001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515918, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
Aug 12 06:25:18 dist-test-slave-gjrz krb5kdc[19001](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515918, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:25:18.136487 20299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "7552f0c853c34a12aafa27b874b50d28"
format_stamp: "Formatted at 2026-08-12 06:25:18 on dist-test-slave-gjrz"
server_key: "47ba91cfb4b1ca49fbb7e9161e92f2f0"
server_key_iv: "55e8df5c03ee867eed672302d03040a1"
server_key_version: "kuduclusterkey@0"
I20260812 06:25:18.137073 20299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "7552f0c853c34a12aafa27b874b50d28"
format_stamp: "Formatted at 2026-08-12 06:25:18 on dist-test-slave-gjrz"
server_key: "47ba91cfb4b1ca49fbb7e9161e92f2f0"
server_key_iv: "55e8df5c03ee867eed672302d03040a1"
server_key_version: "kuduclusterkey@0"
I20260812 06:25:18.138835 20299 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:25:18.166105 20340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:25:18.166409 20299 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260812 06:25:18.166510 20299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "7552f0c853c34a12aafa27b874b50d28"
format_stamp: "Formatted at 2026-08-12 06:25:18 on dist-test-slave-gjrz"
server_key: "47ba91cfb4b1ca49fbb7e9161e92f2f0"
server_key_iv: "55e8df5c03ee867eed672302d03040a1"
server_key_version: "kuduclusterkey@0"
I20260812 06:25:18.166617 20299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:25:18.186966 20299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:25:18.189088 20299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:25:18.189280 20299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:25:18.189531 20299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:25:18.190047 20299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:25:18.190142 20299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:25:18.190212 20299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:25:18.190269 20299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:25:18.200927 20299 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:34161
I20260812 06:25:18.201293 20299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:25:18 dist-test-slave-gjrz krb5kdc[19001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515918, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:25:18.211403 20553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:34161 every 8 connection(s)
I20260812 06:25:18.211452 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 20299
I20260812 06:25:18.211552 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:25:18.211760 30781 external_mini_cluster.cc:1428] Setting key 6d90bbe59e9be063d19dc33c34b8d8da
I20260812 06:25:18.211949 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.202223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:42801 (local address 127.30.15.126:38143)
0812 06:25:18.202269 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:25:18.202271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:25:18.202280 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:25:18.202778 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:25:18.202779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:25:18.202797 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:25:18.202848 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:25:18.203438 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.204015 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.205541 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.205876 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.205920 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.208505 (+ 2585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:25:18.208506 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:25:18.208507 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:25:18.208514 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:25:18.210300 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:25:18.210799 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:25:18.210800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:25:18.210800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:25:18.210875 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:25:18.211148 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:25:18.211149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:25:18.211150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:25:18.211313 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:25:18.211360 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:25:18.211755 (+ 395us) server_negotiation.cc:299] Negotiation successful
0812 06:25:18.211846 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:25:18.215066 20559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.201998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:38143 (local address 127.30.15.66:42801)
0812 06:25:18.202152 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 06:25:18.202194 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:25:18.202683 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:25:18.202928 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:25:18.202932 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:25:18.203113 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:25:18.203346 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.203353 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.204126 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.204127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.205433 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.205437 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.206009 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.206010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.206165 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.206689 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:25:18.206699 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:25:18.208350 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:25:18.210399 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:25:18.210405 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:25:18.210407 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:25:18.210707 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:25:18.210946 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:25:18.210946 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:25:18.210947 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:25:18.211074 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:25:18.211411 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:25:18.211419 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:25:18.211599 (+ 180us) client_negotiation.cc:769] Sending connection context
0812 06:25:18.214677 (+ 3078us) client_negotiation.cc:240] Negotiation successful
0812 06:25:18.214841 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
I20260812 06:25:18.215740 20554 heartbeater.cc:347] Connected to a master server at 127.30.15.126:38143
I20260812 06:25:18.215826 20554 heartbeater.cc:464] Registering TS with master...
I20260812 06:25:18.215998 20554 heartbeater.cc:511] Master 127.30.15.126:38143 requested a full tablet report, sending...
I20260812 06:25:18.216385 19918 ts_manager.cc:194] Registered new tserver with Master: 7552f0c853c34a12aafa27b874b50d28 (127.30.15.66:34161)
I20260812 06:25:18.216892 19918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:42801
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:25:18.249624 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.15.84:57277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38143
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:33149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:25:18.356884 20563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:25:18.357219 20563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:25:18.357306 20563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:25:18.358940 20563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:25:18.359062 20563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:25:18.359148 20563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:25:18.361325 20563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:33149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.30.15.84:57277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:38143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:25:18.361773 20563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:25:18.362097 20563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:25:18.368697 20575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:25:18.369107 20580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:25:18.369836 20563 server_base.cc:1034] running on GCE node
W20260812 06:25:18.370850 20574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:25:18.371133 20563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:25:18.371410 20563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:25:18.372566 20563 hybrid_clock.cc:648] HybridClock initialized: now 1786515918372532 us; error 49 us; skew 500 ppm
Aug 12 06:25:18 dist-test-slave-gjrz krb5kdc[19001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515918, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:25:18.375759 20563 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:25:18.376253 20563 webserver.cc:460] Webserver started at http://127.30.15.67:43837/ using document root <none> and password file <none>
I20260812 06:25:18.376621 20563 fs_manager.cc:359] Metadata directory not provided
I20260812 06:25:18.376724 20563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:25:18.376890 20563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:25:18 dist-test-slave-gjrz krb5kdc[19001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515918, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:25:18.396061 20563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "a21f2622ce234ee7bf487e4bb427d10e"
format_stamp: "Formatted at 2026-08-12 06:25:18 on dist-test-slave-gjrz"
server_key: "6aa6c37660144febadf4399972cd6755"
server_key_iv: "af64e05d602860a9560ce2fe95c13e15"
server_key_version: "kuduclusterkey@0"
I20260812 06:25:18.396569 20563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "a21f2622ce234ee7bf487e4bb427d10e"
format_stamp: "Formatted at 2026-08-12 06:25:18 on dist-test-slave-gjrz"
server_key: "6aa6c37660144febadf4399972cd6755"
server_key_iv: "af64e05d602860a9560ce2fe95c13e15"
server_key_version: "kuduclusterkey@0"
I20260812 06:25:18.400190 20563 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260812 06:25:18.416859 20599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:25:18.417362 20563 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:25:18.417533 20563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "a21f2622ce234ee7bf487e4bb427d10e"
format_stamp: "Formatted at 2026-08-12 06:25:18 on dist-test-slave-gjrz"
server_key: "6aa6c37660144febadf4399972cd6755"
server_key_iv: "af64e05d602860a9560ce2fe95c13e15"
server_key_version: "kuduclusterkey@0"
I20260812 06:25:18.417704 20563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:25:18.436784 20563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:25:18.439043 20563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:25:18.439224 20563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:25:18.439560 20563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:25:18.439973 20563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:25:18.440062 20563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:25:18.440135 20563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:25:18.440194 20563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:25:18.446985 20563 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:35223
I20260812 06:25:18.447245 20822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:35223 every 8 connection(s)
I20260812 06:25:18.449095 20563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:25:18 dist-test-slave-gjrz krb5kdc[19001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515918, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:25:18.456837 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 20563
I20260812 06:25:18.456938 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:25:18.457134 30781 external_mini_cluster.cc:1428] Setting key 408ce95c4a3e65c187de13b358e74d7f
I20260812 06:25:18.458254 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.450004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:50023 (local address 127.30.15.126:38143)
0812 06:25:18.450046 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:25:18.450048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:25:18.450260 (+ 212us) server_negotiation.cc:407] Connection header received
0812 06:25:18.450805 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:25:18.450807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:25:18.450819 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:25:18.450877 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:25:18.451444 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.451943 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.452870 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.453069 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.453125 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.455236 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:25:18.455237 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:25:18.455238 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:25:18.455245 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:25:18.456453 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:25:18.456915 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:25:18.456916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:25:18.456916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:25:18.456987 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:25:18.457386 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:25:18.457387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:25:18.457388 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:25:18.457529 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:25:18.457592 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:25:18.458119 (+ 527us) server_negotiation.cc:299] Negotiation successful
0812 06:25:18.458191 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:25:18.458451 20827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.449997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:38143 (local address 127.30.15.67:50023)
0812 06:25:18.450152 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:25:18.450185 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:25:18.450705 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:25:18.450947 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:25:18.450950 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:25:18.451140 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:25:18.451357 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.451362 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.452027 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.452028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.452787 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.452790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.453141 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.453142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.453258 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.453671 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:25:18.453679 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:25:18.455144 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:25:18.456542 (+ 1398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:25:18.456549 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:25:18.456551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:25:18.456828 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:25:18.457060 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:25:18.457061 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:25:18.457061 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:25:18.457196 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:25:18.457593 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:25:18.457601 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:25:18.457930 (+ 329us) client_negotiation.cc:769] Sending connection context
0812 06:25:18.458082 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 06:25:18.458232 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260812 06:25:18.458882 20823 heartbeater.cc:347] Connected to a master server at 127.30.15.126:38143
I20260812 06:25:18.459022 20823 heartbeater.cc:464] Registering TS with master...
I20260812 06:25:18.459198 20823 heartbeater.cc:511] Master 127.30.15.126:38143 requested a full tablet report, sending...
I20260812 06:25:18.459618 19918 ts_manager.cc:194] Registered new tserver with Master: a21f2622ce234ee7bf487e4bb427d10e (127.30.15.67:35223)
I20260812 06:25:18.459964 19918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:50023
I20260812 06:25:18.468775 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:25:18.476848 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.470041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53588 (local address 127.30.15.126:38143)
0812 06:25:18.470078 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0812 06:25:18.470079 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:25:18.470212 (+ 133us) server_negotiation.cc:407] Connection header received
0812 06:25:18.470259 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:25:18.470260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:25:18.470272 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:25:18.470338 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:25:18.470844 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.471585 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.472362 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.472646 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.472719 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.473850 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:25:18.473852 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:25:18.473852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:25:18.473859 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:25:18.475486 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:25:18.475945 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:25:18.475946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:25:18.475946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:25:18.476007 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:25:18.476214 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:25:18.476215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:25:18.476215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:25:18.476342 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:25:18.476419 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:25:18.476677 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 06:25:18.476755 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:25:18.483618 19918 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53588:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:25:18.485448 19918 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:25:18.494254 20846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.488136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:34161 (local address 127.0.0.1:59426)
0812 06:25:18.489225 (+ 1089us) negotiation.cc:107] Waiting for socket to connect
0812 06:25:18.489230 (+ 5us) client_negotiation.cc:174] Beginning negotiation
0812 06:25:18.489266 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:25:18.489554 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:25:18.489557 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:25:18.489559 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:25:18.489620 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.489622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.491182 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.491183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.492933 (+ 1750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.492936 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.493986 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.493987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.494070 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.494085 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 06:25:18.494132 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 06:25:18.494182 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1081,"thread_start_us":67,"threads_started":1}
I20260812 06:25:18.494612 20852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.488798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59426 (local address 127.30.15.66:34161)
0812 06:25:18.488946 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0812 06:25:18.488951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:25:18.489302 (+ 351us) server_negotiation.cc:407] Connection header received
0812 06:25:18.489350 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:25:18.489353 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:25:18.489369 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:25:18.489441 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:25:18.489697 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.491082 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.493049 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.493890 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.494365 (+ 475us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.494474 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 06:25:18.494500 (+ 26us) server_negotiation.cc:299] Negotiation successful
0812 06:25:18.494536 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
I20260812 06:25:18.495674 20392 tablet_service.cc:1467] Processing CreateTablet for tablet ad0b6a34d48342b7b3e49d0278762532 (DEFAULT_TABLE table=test-table [id=93db5e6aa4694a36a8ed05522a3cc9c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:25:18.496078 20392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad0b6a34d48342b7b3e49d0278762532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:25:18.501384 20850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.487879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:44179 (local address 127.0.0.1:38632)
0812 06:25:18.488987 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0812 06:25:18.489025 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:25:18.489078 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:25:18.489709 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:25:18.489710 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:25:18.489712 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:25:18.489745 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.489746 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.499824 (+ 10078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.499825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.500535 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.500537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.501167 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.501168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.501228 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.501232 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:25:18.501280 (+ 48us) client_negotiation.cc:240] Negotiation successful
0812 06:25:18.501315 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1071,"thread_start_us":79,"threads_started":1}
I20260812 06:25:18.501744 20848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.488133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38632 (local address 127.30.15.65:44179)
0812 06:25:18.489356 (+ 1223us) server_negotiation.cc:206] Beginning negotiation
0812 06:25:18.489360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:25:18.489369 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:25:18.489401 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:25:18.489403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:25:18.489417 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:25:18.489917 (+ 500us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:25:18.489994 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.497854 (+ 7860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.500616 (+ 2762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.501088 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.501148 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.501202 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:25:18.501622 (+ 420us) server_negotiation.cc:299] Negotiation successful
0812 06:25:18.501667 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1190,"thread_start_us":58,"threads_started":1}
I20260812 06:25:18.501892 20847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.487983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:35223 (local address 127.0.0.1:56532)
0812 06:25:18.489152 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0812 06:25:18.489158 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0812 06:25:18.489183 (+ 25us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:25:18.489812 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:25:18.489812 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:25:18.489814 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:25:18.489850 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.489851 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.497979 (+ 8128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.497980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.499062 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.499065 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.501674 (+ 2609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.501676 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.501747 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.501751 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:25:18.501781 (+ 30us) client_negotiation.cc:240] Negotiation successful
0812 06:25:18.501817 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1158,"thread_start_us":64,"threads_started":1}
I20260812 06:25:18.502400 20170 tablet_service.cc:1467] Processing CreateTablet for tablet ad0b6a34d48342b7b3e49d0278762532 (DEFAULT_TABLE table=test-table [id=93db5e6aa4694a36a8ed05522a3cc9c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:25:18.502750 20170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad0b6a34d48342b7b3e49d0278762532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:25:18.503942 20851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.488700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56532 (local address 127.30.15.67:35223)
0812 06:25:18.489547 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0812 06:25:18.489551 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:25:18.489559 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:25:18.489591 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:25:18.489592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:25:18.489606 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:25:18.495792 (+ 6186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:25:18.495873 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.496843 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.499188 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.501481 (+ 2293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.503719 (+ 2238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.503799 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:25:18.503824 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 06:25:18.503860 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":813,"thread_start_us":87,"threads_started":1}
I20260812 06:25:18.504668 20694 tablet_service.cc:1467] Processing CreateTablet for tablet ad0b6a34d48342b7b3e49d0278762532 (DEFAULT_TABLE table=test-table [id=93db5e6aa4694a36a8ed05522a3cc9c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:25:18.504971 20694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad0b6a34d48342b7b3e49d0278762532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:25:18.507642 20858 tablet_bootstrap.cc:492] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e: Bootstrap starting.
I20260812 06:25:18.508102 20857 tablet_bootstrap.cc:492] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc: Bootstrap starting.
I20260812 06:25:18.508845 20858 tablet_bootstrap.cc:654] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e: Neither blocks nor log segments found. Creating new log.
I20260812 06:25:18.508845 20857 tablet_bootstrap.cc:654] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc: Neither blocks nor log segments found. Creating new log.
I20260812 06:25:18.509207 20858 log.cc:824] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:25:18.509207 20857 log.cc:824] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc: Log is configured to *not* fsync() on all Append() calls
I20260812 06:25:18.509545 20854 tablet_bootstrap.cc:492] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28: Bootstrap starting.
I20260812 06:25:18.510522 20854 tablet_bootstrap.cc:654] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28: Neither blocks nor log segments found. Creating new log.
I20260812 06:25:18.510886 20854 log.cc:824] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28: Log is configured to *not* fsync() on all Append() calls
I20260812 06:25:18.511695 20857 tablet_bootstrap.cc:492] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc: No bootstrap required, opened a new log
I20260812 06:25:18.511760 20857 ts_tablet_manager.cc:1397] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 06:25:18.513511 20857 raft_consensus.cc:348] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc293c4c31e43ea896f591b16ce5ecc" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 44179 } } peers { permanent_uuid: "a21f2622ce234ee7bf487e4bb427d10e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 35223 } } peers { permanent_uuid: "7552f0c853c34a12aafa27b874b50d28" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34161 } }
I20260812 06:25:18.513638 20857 raft_consensus.cc:374] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:25:18.513671 20857 raft_consensus.cc:729] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dc293c4c31e43ea896f591b16ce5ecc, State: Initialized, Role: FOLLOWER
I20260812 06:25:18.513804 20857 consensus_queue.cc:260] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc293c4c31e43ea896f591b16ce5ecc" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 44179 } } peers { permanent_uuid: "a21f2622ce234ee7bf487e4bb427d10e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 35223 } } peers { permanent_uuid: "7552f0c853c34a12aafa27b874b50d28" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34161 } }
I20260812 06:25:18.514081 20857 ts_tablet_manager.cc:1428] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:25:18.514127 20285 heartbeater.cc:503] Master 127.30.15.126:38143 was elected leader, sending a full tablet report...
I20260812 06:25:18.514669 20858 tablet_bootstrap.cc:492] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e: No bootstrap required, opened a new log
I20260812 06:25:18.514950 20858 ts_tablet_manager.cc:1397] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260812 06:25:18.516436 20858 raft_consensus.cc:348] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc293c4c31e43ea896f591b16ce5ecc" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 44179 } } peers { permanent_uuid: "a21f2622ce234ee7bf487e4bb427d10e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 35223 } } peers { permanent_uuid: "7552f0c853c34a12aafa27b874b50d28" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34161 } }
I20260812 06:25:18.516561 20858 raft_consensus.cc:374] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:25:18.516593 20858 raft_consensus.cc:729] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a21f2622ce234ee7bf487e4bb427d10e, State: Initialized, Role: FOLLOWER
I20260812 06:25:18.516732 20858 consensus_queue.cc:260] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc293c4c31e43ea896f591b16ce5ecc" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 44179 } } peers { permanent_uuid: "a21f2622ce234ee7bf487e4bb427d10e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 35223 } } peers { permanent_uuid: "7552f0c853c34a12aafa27b874b50d28" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34161 } }
I20260812 06:25:18.516978 20858 ts_tablet_manager.cc:1428] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:25:18.516997 20823 heartbeater.cc:503] Master 127.30.15.126:38143 was elected leader, sending a full tablet report...
I20260812 06:25:18.519721 20854 tablet_bootstrap.cc:492] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28: No bootstrap required, opened a new log
I20260812 06:25:18.519780 20854 ts_tablet_manager.cc:1397] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260812 06:25:18.521297 20854 raft_consensus.cc:348] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc293c4c31e43ea896f591b16ce5ecc" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 44179 } } peers { permanent_uuid: "a21f2622ce234ee7bf487e4bb427d10e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 35223 } } peers { permanent_uuid: "7552f0c853c34a12aafa27b874b50d28" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34161 } }
I20260812 06:25:18.521402 20854 raft_consensus.cc:374] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:25:18.521420 20854 raft_consensus.cc:729] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7552f0c853c34a12aafa27b874b50d28, State: Initialized, Role: FOLLOWER
I20260812 06:25:18.521507 20854 consensus_queue.cc:260] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc293c4c31e43ea896f591b16ce5ecc" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 44179 } } peers { permanent_uuid: "a21f2622ce234ee7bf487e4bb427d10e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 35223 } } peers { permanent_uuid: "7552f0c853c34a12aafa27b874b50d28" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34161 } }
I20260812 06:25:18.521713 20854 ts_tablet_manager.cc:1428] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:25:18.521766 20554 heartbeater.cc:503] Master 127.30.15.126:38143 was elected leader, sending a full tablet report...
I20260812 06:25:18.542470 20868 raft_consensus.cc:482] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:25:18.542587 20868 raft_consensus.cc:504] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc293c4c31e43ea896f591b16ce5ecc" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 44179 } } peers { permanent_uuid: "a21f2622ce234ee7bf487e4bb427d10e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 35223 } } peers { permanent_uuid: "7552f0c853c34a12aafa27b874b50d28" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34161 } }
I20260812 06:25:18.543013 20868 leader_election.cc:288] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dc293c4c31e43ea896f591b16ce5ecc (127.30.15.65:44179), a21f2622ce234ee7bf487e4bb427d10e (127.30.15.67:35223)
I20260812 06:25:18.546746 20559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.542980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:35223 (local address 127.30.15.66:33257)
0812 06:25:18.543202 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 06:25:18.543213 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:25:18.543256 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:25:18.543445 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:25:18.543446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:25:18.543447 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:25:18.543519 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.543520 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.544678 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.544679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.545753 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.545756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.546528 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.546529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.546599 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.546602 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:25:18.546647 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:25:18.546683 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204}
I20260812 06:25:18.547123 20851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.543163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:33257 (local address 127.30.15.67:35223)
0812 06:25:18.543235 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 06:25:18.543237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:25:18.543245 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:25:18.543352 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:25:18.543353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:25:18.543361 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:25:18.543404 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:25:18.543585 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.544318 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.545867 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.546411 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.546490 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.546498 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:25:18.547031 (+ 533us) server_negotiation.cc:299] Negotiation successful
0812 06:25:18.547068 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 06:25:18.547479 20721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a34d48342b7b3e49d0278762532" candidate_uuid: "7552f0c853c34a12aafa27b874b50d28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21f2622ce234ee7bf487e4bb427d10e" is_pre_election: true
I20260812 06:25:18.547608 20721 raft_consensus.cc:2454] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7552f0c853c34a12aafa27b874b50d28 in term 0.
I20260812 06:25:18.547899 20848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.543199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:33999 (local address 127.30.15.65:44179)
0812 06:25:18.543306 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 06:25:18.543308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:25:18.543404 (+ 96us) server_negotiation.cc:407] Connection header received
0812 06:25:18.543488 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:25:18.543489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:25:18.543499 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:25:18.543524 (+ 25us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:25:18.543707 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.544391 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.546949 (+ 2558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.547540 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.547587 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.547595 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:25:18.547802 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 06:25:18.547841 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260812 06:25:18.547883 20344 leader_election.cc:302] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7552f0c853c34a12aafa27b874b50d28, a21f2622ce234ee7bf487e4bb427d10e; no voters:
I20260812 06:25:18.547991 20868 raft_consensus.cc:2781] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:25:18.548030 20868 raft_consensus.cc:482] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:25:18.548051 20868 raft_consensus.cc:3037] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:25:18.548271 20872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.542982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:44179 (local address 127.30.15.66:33999)
0812 06:25:18.543354 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0812 06:25:18.543364 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:25:18.543424 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:25:18.543579 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:25:18.543580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:25:18.543581 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:25:18.543639 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.543640 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.544477 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.544478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.546861 (+ 2383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:25:18.546864 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.547653 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.547654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:25:18.547722 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.547726 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:25:18.548158 (+ 432us) client_negotiation.cc:240] Negotiation successful
0812 06:25:18.548201 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"mutex_wait_us":9,"thread_start_us":77,"threads_started":1}
I20260812 06:25:18.548648 20207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a34d48342b7b3e49d0278762532" candidate_uuid: "7552f0c853c34a12aafa27b874b50d28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc293c4c31e43ea896f591b16ce5ecc" is_pre_election: true
I20260812 06:25:18.548789 20207 raft_consensus.cc:2454] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7552f0c853c34a12aafa27b874b50d28 in term 0.
I20260812 06:25:18.548811 20868 raft_consensus.cc:504] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc293c4c31e43ea896f591b16ce5ecc" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 44179 } } peers { permanent_uuid: "a21f2622ce234ee7bf487e4bb427d10e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 35223 } } peers { permanent_uuid: "7552f0c853c34a12aafa27b874b50d28" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34161 } }
I20260812 06:25:18.549121 20207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a34d48342b7b3e49d0278762532" candidate_uuid: "7552f0c853c34a12aafa27b874b50d28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dc293c4c31e43ea896f591b16ce5ecc"
I20260812 06:25:18.549131 20721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad0b6a34d48342b7b3e49d0278762532" candidate_uuid: "7552f0c853c34a12aafa27b874b50d28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21f2622ce234ee7bf487e4bb427d10e"
I20260812 06:25:18.549197 20721 raft_consensus.cc:3037] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:25:18.549201 20207 raft_consensus.cc:3037] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:25:18.549751 20721 raft_consensus.cc:2454] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7552f0c853c34a12aafa27b874b50d28 in term 1.
I20260812 06:25:18.549817 20868 leader_election.cc:288] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [CANDIDATE]: Term 1 election: Requested vote from peers 3dc293c4c31e43ea896f591b16ce5ecc (127.30.15.65:44179), a21f2622ce234ee7bf487e4bb427d10e (127.30.15.67:35223)
I20260812 06:25:18.549904 20344 leader_election.cc:302] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7552f0c853c34a12aafa27b874b50d28, a21f2622ce234ee7bf487e4bb427d10e; no voters:
I20260812 06:25:18.549968 20868 raft_consensus.cc:2781] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:25:18.550064 20207 raft_consensus.cc:2454] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7552f0c853c34a12aafa27b874b50d28 in term 1.
I20260812 06:25:18.550086 20868 raft_consensus.cc:686] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 1 LEADER]: Becoming Leader. State: Replica: 7552f0c853c34a12aafa27b874b50d28, State: Running, Role: LEADER
I20260812 06:25:18.550156 20868 consensus_queue.cc:237] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc293c4c31e43ea896f591b16ce5ecc" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 44179 } } peers { permanent_uuid: "a21f2622ce234ee7bf487e4bb427d10e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 35223 } } peers { permanent_uuid: "7552f0c853c34a12aafa27b874b50d28" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34161 } }
I20260812 06:25:18.551013 19918 catalog_manager.cc:5495] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7552f0c853c34a12aafa27b874b50d28 (127.30.15.66). New cstate: current_term: 1 leader_uuid: "7552f0c853c34a12aafa27b874b50d28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dc293c4c31e43ea896f591b16ce5ecc" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 44179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a21f2622ce234ee7bf487e4bb427d10e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 35223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7552f0c853c34a12aafa27b874b50d28" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34161 } health_report { overall_health: HEALTHY } } }
I20260812 06:25:18.564544 20852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.561495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59440 (local address 127.30.15.66:34161)
0812 06:25:18.561550 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:25:18.561552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:25:18.561561 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:25:18.561591 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:25:18.561591 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:25:18.561610 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:25:18.561690 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:25:18.561856 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.562552 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.563677 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:25:18.563968 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:25:18.564039 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:25:18.564217 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:25:18.564326 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:25:18.564413 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 06:25:18.564461 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 06:25:18.564481 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:25:18.566504 20721 raft_consensus.cc:1261] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e [term 1 FOLLOWER]: Refusing update from remote peer 7552f0c853c34a12aafa27b874b50d28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:25:18.566612 20207 raft_consensus.cc:1261] T ad0b6a34d48342b7b3e49d0278762532 P 3dc293c4c31e43ea896f591b16ce5ecc [term 1 FOLLOWER]: Refusing update from remote peer 7552f0c853c34a12aafa27b874b50d28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:25:18.570593 20868 consensus_queue.cc:1035] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a21f2622ce234ee7bf487e4bb427d10e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 35223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:25:18.570753 20868 consensus_queue.cc:1035] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dc293c4c31e43ea896f591b16ce5ecc" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 44179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:25:18.574916 20884 mvcc.cc:205] Tried to move back new op lower bound from 7317569202446155776 to 7317569202381967360. Current Snapshot: MvccSnapshot[applied={T|T < 7317569202446155776}]
I20260812 06:25:18.576347 20886 mvcc.cc:205] Tried to move back new op lower bound from 7317569202446155776 to 7317569202381967360. Current Snapshot: MvccSnapshot[applied={T|T < 7317569202446155776}]
I20260812 06:25:18.576522 20892 mvcc.cc:205] Tried to move back new op lower bound from 7317569202446155776 to 7317569202381967360. Current Snapshot: MvccSnapshot[applied={T|T < 7317569202446155776}]
I20260812 06:25:18.581285 19918 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:25:18.581379 19918 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:25:18.582118 19918 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f870c5ac84f5429db627c9178bbfda57: Sending DeleteTablet for 3 replicas of tablet ad0b6a34d48342b7b3e49d0278762532
I20260812 06:25:18.582556 20694 tablet_service.cc:1514] Processing DeleteTablet for tablet ad0b6a34d48342b7b3e49d0278762532 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:25:18 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:56532
I20260812 06:25:18.582748 20392 tablet_service.cc:1514] Processing DeleteTablet for tablet ad0b6a34d48342b7b3e49d0278762532 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:25:18 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:59426
I20260812 06:25:18.583526 20170 tablet_service.cc:1514] Processing DeleteTablet for tablet ad0b6a34d48342b7b3e49d0278762532 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:25:18 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:38632
I20260812 06:25:18.583768 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 20050
I20260812 06:25:18.601394 20907 tablet_replica.cc:330] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28: stopping tablet replica
I20260812 06:25:18.603389 20907 raft_consensus.cc:2229] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:25:18.603603 20905 tablet_replica.cc:330] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e: stopping tablet replica
I20260812 06:25:18.604316 20905 raft_consensus.cc:2229] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:25:18.604540 20907 raft_consensus.cc:2258] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:25:18.604696 20905 raft_consensus.cc:2258] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:25:18.605363 20905 ts_tablet_manager.cc:1905] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 06:25:18.606683 19893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:44179 (error 108)
I20260812 06:25:18.607498 20847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.607384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:44179 (local address 127.0.0.1:38642)
0812 06:25:18.607425 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 06:25:18.607465 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:44179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260812 06:25:18.607508 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 20299
I20260812 06:25:18.607524 20907 ts_tablet_manager.cc:1905] T ad0b6a34d48342b7b3e49d0278762532 P 7552f0c853c34a12aafa27b874b50d28: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 06:25:18.621768 19893 catalog_manager.cc:4584] TS 3dc293c4c31e43ea896f591b16ce5ecc (127.30.15.65:44179): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ad0b6a34d48342b7b3e49d0278762532: Network error: Client connection negotiation failed: client connection to 127.30.15.65:44179: connect: Connection refused (error 111)
I20260812 06:25:18.625787 20905 ts_tablet_manager.cc:1918] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:25:18.625917 20905 log.cc:1196] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/ad0b6a34d48342b7b3e49d0278762532
I20260812 06:25:18.626590 20905 ts_tablet_manager.cc:1939] T ad0b6a34d48342b7b3e49d0278762532 P a21f2622ce234ee7bf487e4bb427d10e: Deleting consensus metadata
I20260812 06:25:18.627786 19892 catalog_manager.cc:4841] TS a21f2622ce234ee7bf487e4bb427d10e (127.30.15.67:35223): tablet ad0b6a34d48342b7b3e49d0278762532 (table test-table [id=93db5e6aa4694a36a8ed05522a3cc9c1]) successfully deleted
I20260812 06:25:18.630712 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 20563
I20260812 06:25:18.635782 20847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:25:18.635608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:34161 (local address 127.0.0.1:59442)
0812 06:25:18.635713 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 06:25:18.635747 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.66:34161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 06:25:18.637585 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 19859
I20260812 06:25:18.650962 30781 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 06:25:18.995481 30781 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 06:25:18.995607 30781 mini_ranger.cc:66] Stopping Ranger...
I20260812 06:25:19.351310 30781 mini_ranger.cc:68] Stopped Ranger
2026-08-12 06:25:19.351 UTC [19054] LOG: received smart shutdown request
2026-08-12 06:25:19.354 UTC [19054] LOG: background worker "logical replication launcher" (PID 19072) exited with exit code 1
2026-08-12 06:25:19.355 UTC [19061] LOG: shutting down
2026-08-12 06:25:19.486 UTC [19054] LOG: database system is shut down
2026-08-12T06:25:19Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (44998 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:25:19 dist-test-slave-gjrz krb5kdc[20927](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:25:19 dist-test-slave-gjrz krb5kdc[20927](info): set up 2 sockets
Aug 12 06:25:19 dist-test-slave-gjrz krb5kdc[20927](info): commencing operation
krb5kdc: starting...
W20260812 06:25:20.759881 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:25:20 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515920, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:25:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:25:20Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.30.15.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.30.15.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/rangeradmin_127.30.15.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/rangeradmin_127.30.15.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.30.15.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.30.15.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/rangerlookup_127.30.15.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/rangerlookup_127.30.15.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.15.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.30.15.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/HTTP_127.30.15.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/HTTP_127.30.15.84@KRBTEST.COM.keytab.
I20260812 06:25:20.906332 30781 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskS3BRRW/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/postgres -l logfile start
2026-08-12 06:25:23.075 UTC [20986] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 06:25:23.076 UTC [20986] LOG: listening on IPv4 address "127.30.15.84", port 53465
2026-08-12 06:25:23.079 UTC [20986] LOG: listening on Unix socket "/tmp/.s.PGSQL.53465"
2026-08-12 06:25:23.106 UTC [20991] LOG: database system was shut down at 2026-08-12 06:25:21 UTC
2026-08-12 06:25:23.109 UTC [20986] LOG: database system is ready to accept connections
I20260812 06:25:24.215812 30781 mini_postgres.cc:96] Postgres bound to 53465
2026-08-12 06:25:24.222 UTC [21006] FATAL: database "slave" does not exist
127.30.15.84:53465 - accepting connections
I20260812 06:25:24.223080 30781 mini_ranger.cc:161] Starting Ranger...
I20260812 06:25:24.237412 30781 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 06:25:24.609571 30781 mini_ranger.cc:87] Created ranger Postgres database
I20260812 06:25:24.609658 30781 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-admin
2026-08-12 06:25:24,884 [I] DB FLAVOR :POSTGRES
2026-08-12 06:25:24,884 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:25:24,885 [I] Checking connection..
2026-08-12 06:25:24,885 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 06:25:25,139 [I] Checking connection passed.
2026-08-12 06:25:25,139 [I] --------- Verifying version history table ---------
2026-08-12 06:25:25,139 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:25:25,395 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:25:25,396 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:25:25,634 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 06:25:25,635 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 06:25:25,635 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 06:25:25.870 UTC [21127] WARNING: there is no transaction in progress
2026-08-12 06:25:25,876 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 06:25:25,877 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 06:25:26,139 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 06:25:26,140 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:25:26,140 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 06:25:26,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 06:25:26,647 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gjrz.c.gcp-upstream.internal','N') ;"
2026-08-12 06:25:26,894 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:25:27,150 [I] Table x_portal_user does not exist in database ranger
2026-08-12 06:25:27,150 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:25:27,406 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 06:25:27,407 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:25:27,651 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:25:27,887 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 06:25:27,887 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 06:25:28.752 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.767 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.781 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.795 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.811 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.829 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.878 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.884 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.896 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.905 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.914 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.926 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.934 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.940 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.945 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:28.951 UTC [21342] WARNING: there is no transaction in progress
2026-08-12 06:25:29,511 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 06:25:29,511 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 06:25:29,746 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 06:25:29,747 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 06:25:29,983 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 06:25:29,983 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 06:25:30,223 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 06:25:30,223 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 06:25:30,472 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 06:25:30,723 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gjrz.c.gcp-upstream.internal';"
2026-08-12 06:25:30,938 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 06:25:30,939 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 06:25:31,195 [I] DB_PATCHES have already been applied
I20260812 06:25:31.200781 30781 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-admin:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskS3BRRW/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 06:25:31.200838 30781 mini_ranger.cc:193] Using host: 127.30.15.84
I20260812 06:25:31.204526 30781 mini_ranger.cc:227] Ranger admin URL: http://127.30.15.84:38553
Aug 12, 2026 6:25:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:25:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:25:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 6:25:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 6:25:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 6:25:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 6:25:32 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 06:25:32.469404 30781 mini_ranger.cc:160] Time spent starting Ranger: real 8.246s user 0.000s sys 0.009s
Aug 12, 2026 6:25:52 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 6:25:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 6:25:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 6:25:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 6:25:52 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 6:25:53 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 06:25:53.749405 30781 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.30.15.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.30.15.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/rangerkms_127.30.15.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.30.15.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/rangerkms_127.30.15.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.15.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.30.15.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.15.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/HTTP_127.30.15.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.15.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/HTTP_127.30.15.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 06:25:53 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515953, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 06:25:53.820336 30781 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 06:25:53.829142 30781 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 06:25:54.495684 30781 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 06:25:54.495752 30781 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-kms
I20260812 06:25:54.495769 30781 mini_ranger_kms.cc:227] Using postgres at 127.30.15.84:53465
2026-08-12 06:25:54,651 [I] DB FLAVOR :POSTGRES
2026-08-12 06:25:54,652 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 06:25:54,652 [I] Checking connection
2026-08-12 06:25:54,652 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 06:25:54,886 [I] connection success
2026-08-12 06:25:54,887 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 06:25:54,887 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 06:25:54,887 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 06:25:55,117 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 06:25:55,118 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 06:25:55,118 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 06:25:55,118 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.15.84:53465/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 06:25:55,360 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 06:25:55.844723 30781 mini_ranger_kms.cc:310] Created kms service
I20260812 06:25:56.021440 30781 mini_ranger_kms.cc:326] Created kudu user
I20260812 06:25:56.065244 30781 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 06:25:56 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515953, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:25:56.434875 30781 mini_ranger_kms.cc:384] Added ranger policy
I20260812 06:25:56.434983 30781 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-kms:/tmp/dist-test-taskS3BRRW/build/release/bin/postgresql.jar:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskS3BRRW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 06:25:56.434999 30781 mini_ranger_kms.cc:240] Using host: 127.30.15.84
I20260812 06:25:56.439594 30781 mini_ranger_kms.cc:276] Ranger KMS PID: 21702
I20260812 06:25:56.439652 30781 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.30.15.84:40855
Aug 12, 2026 6:25:57 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 6:25:57 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 6:25:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 6:25:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 6:25:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 6:25:57 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 06:25:58 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515958, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.15.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:25:59.038900 30781 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.219s user 0.000s sys 0.140s
I20260812 06:25:59.038982 30781 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 06:25:59.039026 30781 mini_ranger_kms.cc:401] 127.30.15.84:40855/kms/v1/keys
Aug 12 06:25:59 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515958, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.15.84@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
Aug 12 06:25:59 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515958, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.15.84@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
Aug 12 06:26:01 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:26:01.785636 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:40243
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:40243
--ranger_config_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.15.84:40855/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:01.890828 21798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:01.891003 21798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:01.891023 21798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:01.892205 21798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:26:01.892246 21798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:01.892259 21798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:01.892270 21798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:26:01.892280 21798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:26:01.893749 21798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/wal
--ranger_kms_url=127.30.15.84:40855/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:40243
--ranger_config_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:40243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:01.893945 21798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:01.894148 21798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:01.898851 21816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:01.898847 21810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:01.898947 21811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:01.899183 21798 server_base.cc:1034] running on GCE node
I20260812 06:26:01.899420 21798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:01.899699 21798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:01.900838 21798 hybrid_clock.cc:648] HybridClock initialized: now 1786515961900822 us; error 33 us; skew 500 ppm
Aug 12 06:26:01 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515961, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:01.903600 21798 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:26:01.903987 21798 webserver.cc:460] Webserver started at http://127.30.15.126:46613/ using document root <none> and password file <none>
I20260812 06:26:01.904186 21798 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:01.904225 21798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:01.904340 21798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:26:01 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515961, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:26:01.950096 21798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "bac8686f4c944459a1eb3e704a643c17"
format_stamp: "Formatted at 2026-08-12 06:26:01 on dist-test-slave-gjrz"
server_key: "50afa63003763287d733dd77d37aa002"
server_key_iv: "0e6ad67cc1631e3cc6830084edf8d575"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:01.950556 21798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "bac8686f4c944459a1eb3e704a643c17"
format_stamp: "Formatted at 2026-08-12 06:26:01 on dist-test-slave-gjrz"
server_key: "50afa63003763287d733dd77d37aa002"
server_key_iv: "0e6ad67cc1631e3cc6830084edf8d575"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:01.952387 21798 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:01.966643 21833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:01.966905 21798 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:01.967002 21798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "bac8686f4c944459a1eb3e704a643c17"
format_stamp: "Formatted at 2026-08-12 06:26:01 on dist-test-slave-gjrz"
server_key: "50afa63003763287d733dd77d37aa002"
server_key_iv: "0e6ad67cc1631e3cc6830084edf8d575"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:01.967088 21798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:01.986193 21798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:01.988080 21798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:01.988221 21798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:01.993088 21798 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:40243
I20260812 06:26:01.993155 21966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:40243 every 8 connection(s)
I20260812 06:26:01.993503 21798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:26:01.994237 21968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:01.996515 21968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17: Bootstrap starting.
I20260812 06:26:01.997072 21968 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:01.997335 21968 log.cc:824] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:01.997974 21968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17: No bootstrap required, opened a new log
I20260812 06:26:02.000034 21968 raft_consensus.cc:348] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac8686f4c944459a1eb3e704a643c17" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40243 } }
I20260812 06:26:02.000175 21968 raft_consensus.cc:374] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:02.000197 21968 raft_consensus.cc:729] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bac8686f4c944459a1eb3e704a643c17, State: Initialized, Role: FOLLOWER
I20260812 06:26:02.000321 21968 consensus_queue.cc:260] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac8686f4c944459a1eb3e704a643c17" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40243 } }
I20260812 06:26:02.000388 21968 raft_consensus.cc:388] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:26:02.000412 21968 raft_consensus.cc:482] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:26:02.000466 21968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:02.000976 21968 raft_consensus.cc:504] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac8686f4c944459a1eb3e704a643c17" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40243 } }
I20260812 06:26:02.001087 21968 leader_election.cc:302] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bac8686f4c944459a1eb3e704a643c17; no voters:
I20260812 06:26:02.001111 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 21798
I20260812 06:26:02.001221 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:26:02.001250 21968 leader_election.cc:288] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:26:02.001288 21973 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:26:02.001427 21973 raft_consensus.cc:686] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 1 LEADER]: Becoming Leader. State: Replica: bac8686f4c944459a1eb3e704a643c17, State: Running, Role: LEADER
I20260812 06:26:02.001432 30781 external_mini_cluster.cc:1428] Setting key 7a858c1a295c18adfd19f75df9508a28
I20260812 06:26:02.001490 21968 sys_catalog.cc:564] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:26:02.001502 21973 consensus_queue.cc:237] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac8686f4c944459a1eb3e704a643c17" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40243 } }
I20260812 06:26:02.002345 21974 sys_catalog.cc:455] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bac8686f4c944459a1eb3e704a643c17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac8686f4c944459a1eb3e704a643c17" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40243 } } }
I20260812 06:26:02.002417 21974 sys_catalog.cc:458] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:02.002655 21978 sys_catalog.cc:455] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bac8686f4c944459a1eb3e704a643c17. Latest consensus state: current_term: 1 leader_uuid: "bac8686f4c944459a1eb3e704a643c17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac8686f4c944459a1eb3e704a643c17" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40243 } } }
I20260812 06:26:02.002715 21978 sys_catalog.cc:458] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:02.003113 21968 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 06:26:02.007725 21999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:26:02.008448 21999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 06:26:02 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:02.016131 21999 catalog_manager.cc:1347] Generated new cluster ID: 36e58e526c12416ab406d32fe8bb0a4b
I20260812 06:26:02.016188 21999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:26:02.017529 21984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:02.001846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.30.15.126:40243)
0812 06:26:02.002131 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:02.002141 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:02.002412 (+ 271us) server_negotiation.cc:407] Connection header received
0812 06:26:02.002531 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:02.002538 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:02.002592 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:02.002727 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:02.005547 (+ 2820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:02.008194 (+ 2647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:02.009345 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:02.010025 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:02.010125 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:02.012961 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:02.012965 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:02.012966 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:02.012978 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:02.015487 (+ 2509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:02.015872 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:02.015875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:02.015876 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:02.015988 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:02.016174 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:02.016175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:02.016175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:02.016565 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:02.016702 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:02.017198 (+ 496us) server_negotiation.cc:299] Negotiation successful
0812 06:26:02.017333 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":89,"threads_started":1}
I20260812 06:26:02.021104 21999 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:26:02.021795 21999 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:26:02.030979 21999 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17: Generated new TSK 0
I20260812 06:26:02.031168 21999 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:26:02.741465 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.15.84:40855/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:40243
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:02.842705 22061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:02.842891 22061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:02.842921 22061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:02.844051 22061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:02.844090 22061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:02.844123 22061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:26:02.845513 22061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.30.15.84:40855/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:40243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:02.845834 22061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:02.846042 22061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:02.850994 22078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:02.851663 22074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:02.851686 22073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:02.851842 22061 server_base.cc:1034] running on GCE node
I20260812 06:26:02.852102 22061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:02.852340 22061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:02.853529 22061 hybrid_clock.cc:648] HybridClock initialized: now 1786515962853506 us; error 41 us; skew 500 ppm
Aug 12 06:26:02 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515962, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:02.857122 22061 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:26:02.857627 22061 webserver.cc:460] Webserver started at http://127.30.15.65:41351/ using document root <none> and password file <none>
I20260812 06:26:02.857869 22061 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:02.857933 22061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:02.858062 22061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:26:02 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515962, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:26:02.872795 22061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "e4aaf796e0dc442cbf8c7899139e4348"
format_stamp: "Formatted at 2026-08-12 06:26:02 on dist-test-slave-gjrz"
server_key: "997bf637869576868eab7988488c5882"
server_key_iv: "ccf881fc65a149c368db7b66b6335051"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:02.873257 22061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "e4aaf796e0dc442cbf8c7899139e4348"
format_stamp: "Formatted at 2026-08-12 06:26:02 on dist-test-slave-gjrz"
server_key: "997bf637869576868eab7988488c5882"
server_key_iv: "ccf881fc65a149c368db7b66b6335051"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:02.875741 22061 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:02.891387 22093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:02.891552 22061 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260812 06:26:02.891644 22061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "e4aaf796e0dc442cbf8c7899139e4348"
format_stamp: "Formatted at 2026-08-12 06:26:02 on dist-test-slave-gjrz"
server_key: "997bf637869576868eab7988488c5882"
server_key_iv: "ccf881fc65a149c368db7b66b6335051"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:02.891721 22061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:02.908259 22061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:02.910663 22061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:02.910815 22061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:02.911038 22061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:02.911450 22061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:02.911520 22061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:02.911552 22061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:02.911574 22061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:02.918392 22061 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:34513
I20260812 06:26:02.918857 22061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:26:02.919004 22308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:34513 every 8 connection(s)
I20260812 06:26:02.927825 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 22061
I20260812 06:26:02.927917 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
Aug 12 06:26:02 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515962, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:02.928117 30781 external_mini_cluster.cc:1428] Setting key b351dc1dacbf5caca48153a262a672a8
I20260812 06:26:02.936239 22316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:02.920793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:40243 (local address 127.30.15.65:47029)
0812 06:26:02.921006 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:02.921078 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:02.921754 (+ 676us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:02.922409 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:02.922414 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:02.922706 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:02.922998 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:02.923005 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:02.924160 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:02.924162 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:02.925443 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:02.925446 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:02.925978 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:02.925979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:02.926127 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:02.926627 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:02.926638 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:02.928335 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:02.930848 (+ 2513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:02.934574 (+ 3726us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:02.934576 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:02.934872 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:02.935122 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:02.935122 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:02.935123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:02.935254 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:02.935600 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:02.935607 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:02.935765 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 06:26:02.935856 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 06:26:02.936008 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":83,"threads_started":1}
I20260812 06:26:02.936985 22317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:02.921136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:47029 (local address 127.30.15.126:40243)
0812 06:26:02.921984 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:02.921986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:02.921995 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:26:02.922022 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:02.922023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:02.922045 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:02.923117 (+ 1072us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:02.923165 (+ 48us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:02.924047 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:02.925550 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:02.925872 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:02.926350 (+ 478us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:02.928924 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:02.928925 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:02.928925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:02.928932 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:02.930737 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:02.934971 (+ 4234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:02.934972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:02.934973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:02.935042 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:02.935359 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:02.935360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:02.935360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:02.935502 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:02.936756 (+ 1254us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:02.936800 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 06:26:02.936888 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":788,"thread_start_us":73,"threads_started":1}
I20260812 06:26:02.937531 22311 heartbeater.cc:347] Connected to a master server at 127.30.15.126:40243
I20260812 06:26:02.937633 22311 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:02.937809 22311 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
I20260812 06:26:02.938381 21863 ts_manager.cc:194] Registered new tserver with Master: e4aaf796e0dc442cbf8c7899139e4348 (127.30.15.65:34513)
I20260812 06:26:02.939155 21863 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:47029
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:26:02.973371 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.15.84:40855/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:40243
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 06:26:03.092077 22325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:03.092327 22325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:03.092358 22325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:03.094029 22325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:03.094084 22325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:03.094121 22325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:26:03.096282 22325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.30.15.84:40855/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:40243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:03.096517 22325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:03.096796 22325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:03.102831 22336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:03.102912 22335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:03.102834 22346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:03.103790 22325 server_base.cc:1034] running on GCE node
I20260812 06:26:03.104015 22325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:03.104292 22325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:03.105451 22325 hybrid_clock.cc:648] HybridClock initialized: now 1786515963105423 us; error 40 us; skew 500 ppm
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:03.108700 22325 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:26:03.109401 22325 webserver.cc:460] Webserver started at http://127.30.15.66:37769/ using document root <none> and password file <none>
I20260812 06:26:03.109721 22325 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:03.109795 22325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:03.109992 22325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:26:03.133378 22325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "ae8599ec463c4e128f6a829e390acadb"
format_stamp: "Formatted at 2026-08-12 06:26:03 on dist-test-slave-gjrz"
server_key: "0426a980fbb38990370a4d75f5aeefb8"
server_key_iv: "745b079039eb63ad5322c11f2e5b0ccf"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:03.133814 22325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "ae8599ec463c4e128f6a829e390acadb"
format_stamp: "Formatted at 2026-08-12 06:26:03 on dist-test-slave-gjrz"
server_key: "0426a980fbb38990370a4d75f5aeefb8"
server_key_iv: "745b079039eb63ad5322c11f2e5b0ccf"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:03.135625 22325 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260812 06:26:03.155545 22359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:03.155719 22325 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260812 06:26:03.155809 22325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "ae8599ec463c4e128f6a829e390acadb"
format_stamp: "Formatted at 2026-08-12 06:26:03 on dist-test-slave-gjrz"
server_key: "0426a980fbb38990370a4d75f5aeefb8"
server_key_iv: "745b079039eb63ad5322c11f2e5b0ccf"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:03.155900 22325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:03.189314 22325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:03.191677 22325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:03.191828 22325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:03.192042 22325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:03.192414 22325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:03.192478 22325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:03.192514 22325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:03.192536 22325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:03.199043 22325 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:34833
I20260812 06:26:03.199498 22325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:26:03.207062 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 22325
I20260812 06:26:03.207196 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:26:03.207428 30781 external_mini_cluster.cc:1428] Setting key 2e0c83aad199a3ba1d20675fdf84c592
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:03.213797 22592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:34833 every 8 connection(s)
I20260812 06:26:03.216362 22317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:03.206152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:38907 (local address 127.30.15.126:40243)
0812 06:26:03.206200 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:03.206202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:03.206513 (+ 311us) server_negotiation.cc:407] Connection header received
0812 06:26:03.207221 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:03.207223 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:03.207240 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:03.207295 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:03.208122 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:03.208799 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:03.210194 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:03.210526 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:03.210573 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:03.213104 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:03.213105 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:03.213106 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:03.213113 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:03.214784 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:03.215240 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:03.215242 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:03.215242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:03.215322 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:03.215618 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:03.215619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:03.215619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:03.215763 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:03.215808 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:03.216177 (+ 369us) server_negotiation.cc:299] Negotiation successful
0812 06:26:03.216266 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:26:03.216858 22596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:03.206163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:40243 (local address 127.30.15.66:38907)
0812 06:26:03.206359 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:03.206411 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:03.207092 (+ 681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:03.207513 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:03.207518 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:03.207751 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:03.208018 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:03.208025 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:03.208925 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:03.208926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:03.210093 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:03.210097 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:03.210679 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:03.210680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:03.210818 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:03.211401 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:03.211411 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:03.212995 (+ 1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:03.214877 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:03.214884 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:03.214886 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:03.215155 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:03.215395 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:03.215395 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:03.215396 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:03.215538 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:03.215856 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:03.215863 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:03.216020 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 06:26:03.216477 (+ 457us) client_negotiation.cc:240] Negotiation successful
0812 06:26:03.216638 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":95,"threads_started":1}
I20260812 06:26:03.217353 22593 heartbeater.cc:347] Connected to a master server at 127.30.15.126:40243
I20260812 06:26:03.217483 22593 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:03.217689 22593 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
I20260812 06:26:03.218117 21863 ts_manager.cc:194] Registered new tserver with Master: ae8599ec463c4e128f6a829e390acadb (127.30.15.66:34833)
I20260812 06:26:03.218602 21863 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:38907
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:26:03.260136 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.15.84:40855/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:40243
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:03.368453 22599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:03.368793 22599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:03.368880 22599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:03.370528 22599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:03.370590 22599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:03.370630 22599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:26:03.372769 22599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.30.15.84:40855/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:40243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:03.373011 22599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:03.373262 22599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:03.380039 22618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:03.380290 22623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:03.380455 22620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:03.381577 22599 server_base.cc:1034] running on GCE node
I20260812 06:26:03.381793 22599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:03.382069 22599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:03.383242 22599 hybrid_clock.cc:648] HybridClock initialized: now 1786515963383222 us; error 33 us; skew 500 ppm
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:03.386479 22599 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:26:03.386988 22599 webserver.cc:460] Webserver started at http://127.30.15.67:45013/ using document root <none> and password file <none>
I20260812 06:26:03.387286 22599 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:03.387358 22599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:03.387620 22599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:26:03.403832 22599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "365e30b7742440259c32f2d3ece16aea"
format_stamp: "Formatted at 2026-08-12 06:26:03 on dist-test-slave-gjrz"
server_key: "f33fca03e0119b10c71dc5304f37ba60"
server_key_iv: "8ddb5a0df65d42866911e200dca394c8"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:03.404260 22599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "365e30b7742440259c32f2d3ece16aea"
format_stamp: "Formatted at 2026-08-12 06:26:03 on dist-test-slave-gjrz"
server_key: "f33fca03e0119b10c71dc5304f37ba60"
server_key_iv: "8ddb5a0df65d42866911e200dca394c8"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:03.406081 22599 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 06:26:03.434433 22633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:03.434690 22599 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.001s sys 0.000s
I20260812 06:26:03.434777 22599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "365e30b7742440259c32f2d3ece16aea"
format_stamp: "Formatted at 2026-08-12 06:26:03 on dist-test-slave-gjrz"
server_key: "f33fca03e0119b10c71dc5304f37ba60"
server_key_iv: "8ddb5a0df65d42866911e200dca394c8"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:03.434857 22599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:03.460389 22599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:03.462738 22599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:03.462929 22599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:03.463215 22599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:03.463673 22599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:03.463765 22599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:03.463827 22599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:03.463851 22599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:03.471489 22599 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:44119
I20260812 06:26:03.471632 22862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:44119 every 8 connection(s)
I20260812 06:26:03.471899 22599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:26:03.477193 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 22599
I20260812 06:26:03.477303 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:26:03.477519 30781 external_mini_cluster.cc:1428] Setting key d915e029ca3bb13aed37ef1a651d904a
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:03.483000 22317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:03.472669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:60907 (local address 127.30.15.126:40243)
0812 06:26:03.472749 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:03.472751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:03.472967 (+ 216us) server_negotiation.cc:407] Connection header received
0812 06:26:03.474202 (+ 1235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:03.474203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:03.474216 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:03.474284 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:03.474955 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:03.475747 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:03.477212 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:03.477526 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:03.477567 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:03.479955 (+ 2388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:03.479957 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:03.479957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:03.479965 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:03.481523 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:03.481996 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:03.481997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:03.481997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:03.482073 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:03.482324 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:03.482325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:03.482325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:03.482460 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:03.482530 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:03.482821 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 06:26:03.482910 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 06:26:03.483137 22866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:03.472658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:40243 (local address 127.30.15.67:60907)
0812 06:26:03.472835 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:03.472877 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:03.474073 (+ 1196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:03.474363 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:03.474368 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:03.474592 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:03.474851 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:03.474858 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:03.475834 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:03.475836 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:03.477108 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:03.477112 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:03.477668 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:03.477669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:03.477807 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:03.478278 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:03.478287 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:03.479856 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:03.481619 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:03.481627 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:03.481629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:03.481919 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:03.482141 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:03.482142 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:03.482142 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:03.482263 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:03.482523 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:03.482528 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:03.482674 (+ 146us) client_negotiation.cc:769] Sending connection context
0812 06:26:03.482776 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 06:26:03.482914 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
I20260812 06:26:03.483773 22863 heartbeater.cc:347] Connected to a master server at 127.30.15.126:40243
I20260812 06:26:03.483865 22863 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:03.484046 22863 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
I20260812 06:26:03.484387 21863 ts_manager.cc:194] Registered new tserver with Master: 365e30b7742440259c32f2d3ece16aea (127.30.15.67:44119)
I20260812 06:26:03.484856 21863 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:60907
I20260812 06:26:03.489269 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:26:03.489881 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 22061
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:26:03.554625 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 22325
I20260812 06:26:03.588631 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 22599
I20260812 06:26:03.599407 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 21798
I20260812 06:26:03.619628 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:40243
--webserver_interface=127.30.15.126
--webserver_port=46613
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:40243
--ranger_config_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.15.84:40855/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.15.84:40855/kms with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:03.703752 22869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:03.703931 22869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:03.703950 22869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:03.705011 22869 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:26:03.705044 22869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:03.705056 22869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:03.705067 22869 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:26:03.705083 22869 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:26:03.706583 22869 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.15.84:40855/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:40243
--ranger_config_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:40243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=46613
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:03.706753 22869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:03.706911 22869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:03.711246 22882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:03.711416 22869 server_base.cc:1034] running on GCE node
W20260812 06:26:03.711246 22879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:03.711326 22878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:03.711699 22869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:03.711989 22869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:03.713124 22869 hybrid_clock.cc:648] HybridClock initialized: now 1786515963713115 us; error 26 us; skew 500 ppm
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:03.715409 22869 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:26:03.715829 22869 webserver.cc:460] Webserver started at http://127.30.15.126:46613/ using document root <none> and password file <none>
I20260812 06:26:03.716048 22869 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:03.716105 22869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:26:03.752410 22869 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:03.753309 22893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:03.753466 22869 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:03.753548 22869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "bac8686f4c944459a1eb3e704a643c17"
format_stamp: "Formatted at 2026-08-12 06:26:01 on dist-test-slave-gjrz"
server_key: "50afa63003763287d733dd77d37aa002"
server_key_iv: "0e6ad67cc1631e3cc6830084edf8d575"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:03.754034 22869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:03.777874 22869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:03.779671 22869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:03.779798 22869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:03.783794 22869 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:40243
I20260812 06:26:03.783854 22985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:40243 every 8 connection(s)
I20260812 06:26:03.784192 22869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:26:03.785372 22986 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:26:03.785663 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 22869
I20260812 06:26:03.785981 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.15.84:40855/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:34513
--local_ip_for_outbound_sockets=127.30.15.65
--tserver_master_addrs=127.30.15.126:40243
--webserver_port=41351
--webserver_interface=127.30.15.65
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.15.84:40855/kms with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:26:03.786247 22986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17: Bootstrap starting.
I20260812 06:26:03.794741 22986 log.cc:824] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:03.796389 22986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:26:03.796645 22986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17: Bootstrap complete.
I20260812 06:26:03.798844 22986 raft_consensus.cc:348] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac8686f4c944459a1eb3e704a643c17" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40243 } }
I20260812 06:26:03.799068 22986 raft_consensus.cc:729] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bac8686f4c944459a1eb3e704a643c17, State: Initialized, Role: FOLLOWER
I20260812 06:26:03.799220 22986 consensus_queue.cc:260] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac8686f4c944459a1eb3e704a643c17" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40243 } }
I20260812 06:26:03.799306 22986 raft_consensus.cc:388] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:26:03.799355 22986 raft_consensus.cc:482] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:26:03.799397 22986 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:26:03.800387 22986 raft_consensus.cc:504] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac8686f4c944459a1eb3e704a643c17" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40243 } }
I20260812 06:26:03.800482 22986 leader_election.cc:302] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bac8686f4c944459a1eb3e704a643c17; no voters:
I20260812 06:26:03.800634 22986 leader_election.cc:288] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:26:03.800678 22998 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:26:03.800796 22998 raft_consensus.cc:686] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [term 2 LEADER]: Becoming Leader. State: Replica: bac8686f4c944459a1eb3e704a643c17, State: Running, Role: LEADER
I20260812 06:26:03.800896 22986 sys_catalog.cc:564] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:26:03.800887 22998 consensus_queue.cc:237] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac8686f4c944459a1eb3e704a643c17" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40243 } }
I20260812 06:26:03.801296 22998 sys_catalog.cc:455] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bac8686f4c944459a1eb3e704a643c17. Latest consensus state: current_term: 2 leader_uuid: "bac8686f4c944459a1eb3e704a643c17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac8686f4c944459a1eb3e704a643c17" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40243 } } }
I20260812 06:26:03.801376 22998 sys_catalog.cc:458] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:03.801517 23000 sys_catalog.cc:455] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bac8686f4c944459a1eb3e704a643c17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bac8686f4c944459a1eb3e704a643c17" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40243 } } }
I20260812 06:26:03.801577 23000 sys_catalog.cc:458] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:03.801785 23006 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:26:03.802280 23006 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:26:03.802403 23006 catalog_manager.cc:1259] Loaded cluster ID: 36e58e526c12416ab406d32fe8bb0a4b
I20260812 06:26:03.802445 23006 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:26:03.802603 22986 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 06:26:03.806133 23006 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:26:03.806643 23006 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17: Loaded TSK: 0
I20260812 06:26:03.806959 23006 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:26:03.872314 22990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:03.872491 22990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:03.872521 22990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:03.873626 22990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:03.873669 22990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:03.873703 22990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:26:03.875519 22990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.15.84:40855/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:34513
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=41351
--tserver_master_addrs=127.30.15.126:40243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:03.875757 22990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:03.876008 22990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:03.881953 23062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:03.882018 23059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:03.882468 23067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:03.882431 22990 server_base.cc:1034] running on GCE node
I20260812 06:26:03.882727 22990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:03.882958 22990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:03.884119 22990 hybrid_clock.cc:648] HybridClock initialized: now 1786515963884093 us; error 44 us; skew 500 ppm
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:03.886442 22990 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:26:03.886899 22990 webserver.cc:460] Webserver started at http://127.30.15.65:41351/ using document root <none> and password file <none>
I20260812 06:26:03.887133 22990 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:03.887197 22990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:26:03.912744 22990 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.000s sys 0.001s
I20260812 06:26:03.913952 23086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:03.914089 22990 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:26:03.914167 22990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "e4aaf796e0dc442cbf8c7899139e4348"
format_stamp: "Formatted at 2026-08-12 06:26:02 on dist-test-slave-gjrz"
server_key: "997bf637869576868eab7988488c5882"
server_key_iv: "ccf881fc65a149c368db7b66b6335051"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:03.914517 22990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:03.934064 22990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:03.936218 22990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:03.936369 22990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:03.936599 22990 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:03.936975 22990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:03.937027 22990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:03.937067 22990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:03.937091 22990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:03.943907 22990 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:34513
I20260812 06:26:03.944377 22990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:26:03.948063 23291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:34513 every 8 connection(s)
Aug 12 06:26:03 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515963, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:03.953594 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 22990
I20260812 06:26:03.953915 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.15.84:40855/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:34833
--local_ip_for_outbound_sockets=127.30.15.66
--tserver_master_addrs=127.30.15.126:40243
--webserver_port=37769
--webserver_interface=127.30.15.66
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.15.84:40855/kms with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:26:03.955492 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:03.945328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:40243 (local address 127.30.15.65:49743)
0812 06:26:03.945594 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:03.945627 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:03.946231 (+ 604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:03.946771 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:03.946776 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:03.946955 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:03.947131 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:03.947135 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:03.948853 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:03.948854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:03.949637 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:03.949640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:03.950243 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:03.950244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:03.950374 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:03.950795 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:03.950803 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:03.952006 (+ 1203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:03.953775 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:03.953783 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:03.953785 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:03.954069 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:03.954327 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:03.954328 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:03.954328 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:03.954439 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:03.954870 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:03.954877 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:03.955033 (+ 156us) client_negotiation.cc:769] Sending connection context
0812 06:26:03.955124 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 06:26:03.955289 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":75,"threads_started":1}
I20260812 06:26:03.956151 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:03.945412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:49743 (local address 127.30.15.126:40243)
0812 06:26:03.946402 (+ 990us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:03.946409 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:03.946434 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:26:03.946556 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:03.946560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:03.946598 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:03.946708 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:03.947250 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:03.948751 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:03.949722 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:03.950136 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:03.950232 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:03.952131 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:03.952135 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:03.952135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:03.952145 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:03.953683 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:03.954159 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:03.954162 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:03.954163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:03.954263 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:03.954506 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:03.954507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:03.954507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:03.954775 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:03.954842 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:03.955781 (+ 939us) server_negotiation.cc:299] Negotiation successful
0812 06:26:03.955909 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":941,"thread_start_us":74,"threads_started":1}
I20260812 06:26:03.956830 23292 heartbeater.cc:347] Connected to a master server at 127.30.15.126:40243
I20260812 06:26:03.956969 23292 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:03.957185 23292 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
W20260812 06:26:03.958103 23292 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:40243 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 06:26:03.958173 23292 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:03.958232 23292 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
I20260812 06:26:03.958617 23292 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:03.958693 23292 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
W20260812 06:26:03.958985 23292 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:26:04.072551 23299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:04.072811 23299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:04.072849 23299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:04.074469 23299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:04.074529 23299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:04.074568 23299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:26:04.076678 23299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.15.84:40855/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:34833
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=37769
--tserver_master_addrs=127.30.15.126:40243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:04.076929 23299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:04.077188 23299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:04.082672 23306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:04.082682 23309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:04.083670 23314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:04.084061 23299 server_base.cc:1034] running on GCE node
I20260812 06:26:04.084266 23299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:04.084511 23299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:04.087756 23299 hybrid_clock.cc:648] HybridClock initialized: now 1786515964087237 us; error 534 us; skew 500 ppm
Aug 12 06:26:04 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515964, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:04.090644 23299 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:26:04.091250 23299 webserver.cc:460] Webserver started at http://127.30.15.66:37769/ using document root <none> and password file <none>
I20260812 06:26:04.091574 23299 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:04.091655 23299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 06:26:04 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515964, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:26:04.112880 23299 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:04.113948 23332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:04.114142 23299 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:04.114233 23299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "ae8599ec463c4e128f6a829e390acadb"
format_stamp: "Formatted at 2026-08-12 06:26:03 on dist-test-slave-gjrz"
server_key: "0426a980fbb38990370a4d75f5aeefb8"
server_key_iv: "745b079039eb63ad5322c11f2e5b0ccf"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:04.114588 23299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:04.134941 23299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:04.137173 23299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:04.137331 23299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:04.137600 23299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:04.137969 23299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:04.138019 23299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:04.138047 23299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:04.138070 23299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:04.144933 23299 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:34833
I20260812 06:26:04.145022 23542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:34833 every 8 connection(s)
I20260812 06:26:04.145310 23299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:26:04 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515964, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:04.152633 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 23299
I20260812 06:26:04.152942 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.15.84:40855/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:44119
--local_ip_for_outbound_sockets=127.30.15.67
--tserver_master_addrs=127.30.15.126:40243
--webserver_port=45013
--webserver_interface=127.30.15.67
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.15.84:40855/kms with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:26:04.153607 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:04.146027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:58767 (local address 127.30.15.126:40243)
0812 06:26:04.146074 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:04.146076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:04.146294 (+ 218us) server_negotiation.cc:407] Connection header received
0812 06:26:04.146784 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:04.146785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:04.146801 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:04.146853 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:04.147379 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:04.147999 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:04.148949 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:04.149157 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:04.149213 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:04.151045 (+ 1832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:04.151047 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:04.151047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:04.151054 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:04.152292 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:04.152654 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:04.152655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:04.152655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:04.152713 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:04.152945 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:04.152946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:04.152946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:04.153080 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:04.153139 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:04.153432 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 06:26:04.153518 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260812 06:26:04.153744 23547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:04.146029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:40243 (local address 127.30.15.66:58767)
0812 06:26:04.146182 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:04.146221 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:04.146689 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:04.146919 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:04.146923 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:04.147091 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:04.147297 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:04.147302 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:04.148090 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:04.148091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:04.148869 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:04.148871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:04.149248 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:04.149249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:04.149370 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:04.149779 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:04.149788 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:04.150962 (+ 1174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:04.152364 (+ 1402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:04.152371 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:04.152373 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:04.152589 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:04.152782 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:04.152783 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:04.152783 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:04.152885 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:04.153165 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:04.153172 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:04.153311 (+ 139us) client_negotiation.cc:769] Sending connection context
0812 06:26:04.153398 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 06:26:04.153540 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260812 06:26:04.154368 23544 heartbeater.cc:347] Connected to a master server at 127.30.15.126:40243
I20260812 06:26:04.154467 23544 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:04.154639 23544 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
W20260812 06:26:04.155339 23544 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:40243 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 06:26:04.155411 23544 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:04.155483 23544 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
I20260812 06:26:04.155788 23544 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:04.155859 23544 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
W20260812 06:26:04.156163 23544 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:26:04.245105 23548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:04.245456 23548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:04.245555 23548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:04.247205 23548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:04.247329 23548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:04.247416 23548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:26:04.249522 23548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.15.84:40855/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:44119
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=45013
--tserver_master_addrs=127.30.15.126:40243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:04.249943 23548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:04.250267 23548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:04.255777 23556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:04.255777 23555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:04.256101 23562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:04.256392 23548 server_base.cc:1034] running on GCE node
I20260812 06:26:04.256577 23548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:04.256806 23548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:04.258392 23548 hybrid_clock.cc:648] HybridClock initialized: now 1786515964258367 us; error 45 us; skew 500 ppm
Aug 12 06:26:04 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515964, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:04.261001 23548 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:26:04.261416 23548 webserver.cc:460] Webserver started at http://127.30.15.67:45013/ using document root <none> and password file <none>
I20260812 06:26:04.261632 23548 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:04.261693 23548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 06:26:04 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515964, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:26:04.279116 23548 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:04.280417 23574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:04.280586 23548 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:26:04.280660 23548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "365e30b7742440259c32f2d3ece16aea"
format_stamp: "Formatted at 2026-08-12 06:26:03 on dist-test-slave-gjrz"
server_key: "f33fca03e0119b10c71dc5304f37ba60"
server_key_iv: "8ddb5a0df65d42866911e200dca394c8"
server_key_version: "kuduclusterkey@0"
I20260812 06:26:04.281066 23548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:04.314702 23548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:04.316550 23548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:04.316680 23548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:04.316898 23548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:04.317184 23548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:04.317224 23548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:04.317309 23548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:04.317344 23548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:04.324107 23548 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:44119
I20260812 06:26:04.324481 23548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:26:04.324781 23801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:44119 every 8 connection(s)
Aug 12 06:26:04 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515964, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:04.333812 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 23548
I20260812 06:26:04.337119 23296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:04.325363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:50427 (local address 127.30.15.126:40243)
0812 06:26:04.325408 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:04.325410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:04.325717 (+ 307us) server_negotiation.cc:407] Connection header received
0812 06:26:04.326277 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:04.326278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:04.326292 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:04.326343 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:04.326850 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:04.327377 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:04.328685 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:04.329013 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:04.329058 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:04.332455 (+ 3397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:04.332457 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:04.332458 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:04.332466 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:04.333873 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:04.335583 (+ 1710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:04.335584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:04.335585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:04.335643 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:04.335856 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:04.335857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:04.335857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:04.335972 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:04.336030 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:04.336934 (+ 904us) server_negotiation.cc:299] Negotiation successful
0812 06:26:04.337038 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:26:04.337505 23812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:04.325375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:40243 (local address 127.30.15.67:50427)
0812 06:26:04.325567 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:04.325614 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:04.326176 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:04.326411 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:04.326415 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:04.326580 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:04.326761 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:04.326765 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:04.327455 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:04.327456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:04.328571 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:04.328575 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:04.329168 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:04.329169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:04.329308 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:04.329812 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:04.329822 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:04.332289 (+ 2467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:04.335204 (+ 2915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:04.335210 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:04.335212 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:04.335523 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:04.335698 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:04.335698 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:04.335699 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:04.335797 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:04.336029 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:04.336036 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:04.336170 (+ 134us) client_negotiation.cc:769] Sending connection context
0812 06:26:04.337200 (+ 1030us) client_negotiation.cc:240] Negotiation successful
0812 06:26:04.337342 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":94,"threads_started":1}
I20260812 06:26:04.337924 23802 heartbeater.cc:347] Connected to a master server at 127.30.15.126:40243
I20260812 06:26:04.338013 23802 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:04.338188 23802 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
W20260812 06:26:04.338821 23802 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:40243 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 06:26:04.338883 23802 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:04.338940 23802 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
I20260812 06:26:04.339339 23802 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:04.339424 23802 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
W20260812 06:26:04.339809 23802 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:26:04.341976 23817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:04.334239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47700 (local address 127.30.15.126:40243)
0812 06:26:04.335370 (+ 1131us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:04.335373 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:04.335381 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:26:04.335402 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:04.335403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:04.335415 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:04.335500 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:04.336238 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:04.336958 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:04.338030 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:04.338308 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:04.338476 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:04.339797 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:04.339798 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:04.339798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:04.339804 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:04.340999 (+ 1195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:04.341290 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:04.341291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:04.341291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:04.341345 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:04.341505 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:04.341505 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:04.341506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:04.341609 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:04.341763 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:04.341799 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 06:26:04.341870 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1101,"thread_start_us":66,"threads_started":1}
Aug 12 06:26:04 dist-test-slave-gjrz krb5kdc[20927](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786515964, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:04.959143 23292 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:04.959302 23292 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
I20260812 06:26:04.959628 22927 ts_manager.cc:194] Registered new tserver with Master: e4aaf796e0dc442cbf8c7899139e4348 (127.30.15.65:34513)
I20260812 06:26:04.960304 22927 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:49743
I20260812 06:26:05.156283 23544 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:05.156438 23544 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
I20260812 06:26:05.156847 22924 ts_manager.cc:194] Registered new tserver with Master: ae8599ec463c4e128f6a829e390acadb (127.30.15.66:34833)
I20260812 06:26:05.157394 22924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:58767
Aug 12 06:26:05 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515964, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
I20260812 06:26:05.339988 23802 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:05.340142 23802 heartbeater.cc:511] Master 127.30.15.126:40243 requested a full tablet report, sending...
I20260812 06:26:05.340442 22927 ts_manager.cc:194] Registered new tserver with Master: 365e30b7742440259c32f2d3ece16aea (127.30.15.67:44119)
I20260812 06:26:05.340981 22927 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:50427
I20260812 06:26:05.349675 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:26:05.358672 23851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.350844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47710 (local address 127.30.15.126:40243)
0812 06:26:05.351036 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:05.351038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:05.351148 (+ 110us) server_negotiation.cc:407] Connection header received
0812 06:26:05.351239 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:05.351240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:05.351251 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:05.351314 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:05.352058 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.352838 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.353871 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.354195 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.354235 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:05.355746 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:05.355747 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:05.355747 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:05.355755 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:05.357413 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:05.357819 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:05.357820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:05.357820 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:05.357880 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:05.358081 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:05.358082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:05.358082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:05.358206 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:05.358281 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:05.358485 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 06:26:05.358570 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":76,"threads_started":1}
I20260812 06:26:05.364951 22927 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47710:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:26:05.367187 22927 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:26:05.378863 23866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.370828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:34833 (local address 127.0.0.1:33446)
0812 06:26:05.371202 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:05.371242 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:05.371367 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:05.371915 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:05.371918 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:05.371932 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:05.371997 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:05.371999 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.373224 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.373225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:05.374793 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:05.374796 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.378568 (+ 3772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.378569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:05.378653 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:05.378667 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 06:26:05.378730 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 06:26:05.378778 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":83,"threads_started":1}
I20260812 06:26:05.379318 23869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.370934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33446 (local address 127.30.15.66:34833)
0812 06:26:05.371144 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:05.371149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:05.371326 (+ 177us) server_negotiation.cc:407] Connection header received
0812 06:26:05.371723 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:05.371726 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:05.371742 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:05.371805 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:05.372072 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.373133 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.374890 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.376021 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.376084 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:05.376143 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:05.379167 (+ 3024us) server_negotiation.cc:299] Negotiation successful
0812 06:26:05.379215 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":65,"threads_started":1}
I20260812 06:26:05.380227 23421 tablet_service.cc:1467] Processing CreateTablet for tablet 0b1d220ec5544feeae6cd5385e466472 (DEFAULT_TABLE table=test-table [id=91ebf252264a4d2ab64ae9a6b484d8da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:05.380661 23421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b1d220ec5544feeae6cd5385e466472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:05.381577 23863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.370835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:34513 (local address 127.0.0.1:43688)
0812 06:26:05.376290 (+ 5455us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:05.376300 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:05.376354 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:05.376609 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:05.376610 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:05.376612 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:05.376652 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:05.376653 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.377825 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.377826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:05.380325 (+ 2499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:05.380328 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.381352 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.381353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:05.381418 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:05.381421 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:26:05.381466 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:26:05.381503 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5437,"thread_start_us":93,"threads_started":1}
I20260812 06:26:05.382071 23867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.370940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43688 (local address 127.30.15.65:34513)
0812 06:26:05.376227 (+ 5287us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:05.376232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:05.376405 (+ 173us) server_negotiation.cc:407] Connection header received
0812 06:26:05.376441 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:05.376444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:05.376459 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:05.376520 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:05.376718 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.377732 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.380424 (+ 2692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.381196 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.381262 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:05.381316 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:05.381948 (+ 632us) server_negotiation.cc:299] Negotiation successful
0812 06:26:05.381992 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5247,"thread_start_us":52,"threads_started":1}
I20260812 06:26:05.384749 23176 tablet_service.cc:1467] Processing CreateTablet for tablet 0b1d220ec5544feeae6cd5385e466472 (DEFAULT_TABLE table=test-table [id=91ebf252264a4d2ab64ae9a6b484d8da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:05.385080 23176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b1d220ec5544feeae6cd5385e466472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:05.386453 23872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.371080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:44119 (local address 127.0.0.1:41086)
0812 06:26:05.376322 (+ 5242us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:05.376333 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:05.376388 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:05.382638 (+ 6250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:05.382639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:05.382642 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:05.382683 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:05.382684 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.384040 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.384041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:05.385224 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:05.385227 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.386242 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.386243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:05.386312 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:05.386317 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:26:05.386346 (+ 29us) client_negotiation.cc:240] Negotiation successful
0812 06:26:05.386384 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5221,"thread_start_us":60,"threads_started":1}
I20260812 06:26:05.386829 23873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.371281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41086 (local address 127.30.15.67:44119)
0812 06:26:05.382478 (+ 11197us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:05.382482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:05.382495 (+ 13us) server_negotiation.cc:407] Connection header received
0812 06:26:05.382530 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:05.382532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:05.382548 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:05.382632 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:05.382782 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.383941 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.385329 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.386130 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.386613 (+ 483us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:05.386682 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:05.386709 (+ 27us) server_negotiation.cc:299] Negotiation successful
0812 06:26:05.386754 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8332,"thread_start_us":46,"threads_started":1}
I20260812 06:26:05.389195 23635 tablet_service.cc:1467] Processing CreateTablet for tablet 0b1d220ec5544feeae6cd5385e466472 (DEFAULT_TABLE table=test-table [id=91ebf252264a4d2ab64ae9a6b484d8da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:05.389526 23635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b1d220ec5544feeae6cd5385e466472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:05.393582 23875 tablet_bootstrap.cc:492] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348: Bootstrap starting.
I20260812 06:26:05.394301 23875 tablet_bootstrap.cc:654] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:05.394721 23875 log.cc:824] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:05.394937 23877 tablet_bootstrap.cc:492] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea: Bootstrap starting.
I20260812 06:26:05.395634 23877 tablet_bootstrap.cc:654] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:05.396206 23877 log.cc:824] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:05.396606 23874 tablet_bootstrap.cc:492] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb: Bootstrap starting.
I20260812 06:26:05.397257 23874 tablet_bootstrap.cc:654] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:05.397639 23874 log.cc:824] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:05.398456 23877 tablet_bootstrap.cc:492] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea: No bootstrap required, opened a new log
I20260812 06:26:05.398587 23877 ts_tablet_manager.cc:1397] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260812 06:26:05.400822 23877 raft_consensus.cc:348] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae8599ec463c4e128f6a829e390acadb" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34833 } } peers { permanent_uuid: "e4aaf796e0dc442cbf8c7899139e4348" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34513 } } peers { permanent_uuid: "365e30b7742440259c32f2d3ece16aea" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44119 } }
I20260812 06:26:05.401093 23877 raft_consensus.cc:374] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:05.401490 23875 tablet_bootstrap.cc:492] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348: No bootstrap required, opened a new log
I20260812 06:26:05.401566 23875 ts_tablet_manager.cc:1397] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260812 06:26:05.403784 23875 raft_consensus.cc:348] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae8599ec463c4e128f6a829e390acadb" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34833 } } peers { permanent_uuid: "e4aaf796e0dc442cbf8c7899139e4348" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34513 } } peers { permanent_uuid: "365e30b7742440259c32f2d3ece16aea" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44119 } }
I20260812 06:26:05.403936 23875 raft_consensus.cc:374] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:05.403970 23875 raft_consensus.cc:729] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4aaf796e0dc442cbf8c7899139e4348, State: Initialized, Role: FOLLOWER
I20260812 06:26:05.404208 23875 consensus_queue.cc:260] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae8599ec463c4e128f6a829e390acadb" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34833 } } peers { permanent_uuid: "e4aaf796e0dc442cbf8c7899139e4348" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34513 } } peers { permanent_uuid: "365e30b7742440259c32f2d3ece16aea" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44119 } }
I20260812 06:26:05.404590 23875 ts_tablet_manager.cc:1428] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:26:05.404757 23292 heartbeater.cc:503] Master 127.30.15.126:40243 was elected leader, sending a full tablet report...
I20260812 06:26:05.405190 23877 raft_consensus.cc:729] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 365e30b7742440259c32f2d3ece16aea, State: Initialized, Role: FOLLOWER
I20260812 06:26:05.405400 23877 consensus_queue.cc:260] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae8599ec463c4e128f6a829e390acadb" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34833 } } peers { permanent_uuid: "e4aaf796e0dc442cbf8c7899139e4348" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34513 } } peers { permanent_uuid: "365e30b7742440259c32f2d3ece16aea" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44119 } }
I20260812 06:26:05.405747 23877 ts_tablet_manager.cc:1428] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260812 06:26:05.405906 23802 heartbeater.cc:503] Master 127.30.15.126:40243 was elected leader, sending a full tablet report...
I20260812 06:26:05.407136 23874 tablet_bootstrap.cc:492] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb: No bootstrap required, opened a new log
I20260812 06:26:05.407297 23874 ts_tablet_manager.cc:1397] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260812 06:26:05.409884 23874 raft_consensus.cc:348] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae8599ec463c4e128f6a829e390acadb" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34833 } } peers { permanent_uuid: "e4aaf796e0dc442cbf8c7899139e4348" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34513 } } peers { permanent_uuid: "365e30b7742440259c32f2d3ece16aea" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44119 } }
I20260812 06:26:05.410096 23874 raft_consensus.cc:374] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:05.410184 23874 raft_consensus.cc:729] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae8599ec463c4e128f6a829e390acadb, State: Initialized, Role: FOLLOWER
I20260812 06:26:05.410353 23874 consensus_queue.cc:260] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae8599ec463c4e128f6a829e390acadb" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34833 } } peers { permanent_uuid: "e4aaf796e0dc442cbf8c7899139e4348" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34513 } } peers { permanent_uuid: "365e30b7742440259c32f2d3ece16aea" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44119 } }
I20260812 06:26:05.410759 23874 ts_tablet_manager.cc:1428] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:26:05.410913 23544 heartbeater.cc:503] Master 127.30.15.126:40243 was elected leader, sending a full tablet report...
W20260812 06:26:05.449308 23293 tablet.cc:2369] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 06:26:05 dist-test-slave-gjrz krb5kdc[20927](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515964, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for HTTP/127.30.15.84@KRBTEST.COM
W20260812 06:26:05.575721 23809 tablet.cc:2369] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:26:05.642256 23885 raft_consensus.cc:482] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:26:05.642422 23885 raft_consensus.cc:504] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae8599ec463c4e128f6a829e390acadb" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34833 } } peers { permanent_uuid: "e4aaf796e0dc442cbf8c7899139e4348" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34513 } } peers { permanent_uuid: "365e30b7742440259c32f2d3ece16aea" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44119 } }
I20260812 06:26:05.642836 23885 leader_election.cc:288] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae8599ec463c4e128f6a829e390acadb (127.30.15.66:34833), 365e30b7742440259c32f2d3ece16aea (127.30.15.67:44119)
W20260812 06:26:05.646692 23545 tablet.cc:2369] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:26:05.647598 23869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.643732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:40271 (local address 127.30.15.66:34833)
0812 06:26:05.643778 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:05.643781 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:05.643910 (+ 129us) server_negotiation.cc:407] Connection header received
0812 06:26:05.644031 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:05.644033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:05.644043 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:05.644071 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:05.644297 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.645058 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.646542 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.647116 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.647197 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:05.647208 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:05.647468 (+ 260us) server_negotiation.cc:299] Negotiation successful
0812 06:26:05.647517 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:26:05.648097 23894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.643130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:34833 (local address 127.30.15.65:40271)
0812 06:26:05.643843 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:05.643855 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:05.643951 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:05.644138 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:05.644139 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:05.644141 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:05.644230 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:05.644232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.645160 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.645161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:05.646433 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:05.646436 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.647294 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.647296 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:05.647374 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:05.647379 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:26:05.647885 (+ 506us) client_negotiation.cc:240] Negotiation successful
0812 06:26:05.647992 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"mutex_wait_us":48,"thread_start_us":102,"threads_started":1}
I20260812 06:26:05.648581 23455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b1d220ec5544feeae6cd5385e466472" candidate_uuid: "e4aaf796e0dc442cbf8c7899139e4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae8599ec463c4e128f6a829e390acadb" is_pre_election: true
I20260812 06:26:05.648737 23455 raft_consensus.cc:2454] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4aaf796e0dc442cbf8c7899139e4348 in term 0.
I20260812 06:26:05.648967 23090 leader_election.cc:302] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae8599ec463c4e128f6a829e390acadb, e4aaf796e0dc442cbf8c7899139e4348; no voters:
I20260812 06:26:05.649092 23885 raft_consensus.cc:2781] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:26:05.649132 23885 raft_consensus.cc:482] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:26:05.649151 23885 raft_consensus.cc:3037] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:05.650045 23873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.643770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:38803 (local address 127.30.15.67:44119)
0812 06:26:05.643827 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:05.643829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:05.646630 (+ 2801us) server_negotiation.cc:407] Connection header received
0812 06:26:05.646723 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:05.646724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:05.646733 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:05.646760 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:05.646963 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.647708 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.649114 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.649667 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.649712 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:05.649719 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:05.649939 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 06:26:05.649979 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:26:05.650112 23885 raft_consensus.cc:504] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae8599ec463c4e128f6a829e390acadb" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34833 } } peers { permanent_uuid: "e4aaf796e0dc442cbf8c7899139e4348" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34513 } } peers { permanent_uuid: "365e30b7742440259c32f2d3ece16aea" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44119 } }
I20260812 06:26:05.650249 23885 leader_election.cc:288] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [CANDIDATE]: Term 1 election: Requested vote from peers ae8599ec463c4e128f6a829e390acadb (127.30.15.66:34833), 365e30b7742440259c32f2d3ece16aea (127.30.15.67:44119)
I20260812 06:26:05.650734 23893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.643397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:44119 (local address 127.30.15.65:38803)
0812 06:26:05.646578 (+ 3181us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:05.646587 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:05.646655 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:05.646818 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:05.646819 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:05.646821 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:05.646881 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:05.646883 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.647805 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.647806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:05.648951 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:05.648954 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.649777 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.649778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:05.649851 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:05.649858 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 06:26:05.650615 (+ 757us) client_negotiation.cc:240] Negotiation successful
0812 06:26:05.650657 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3164,"thread_start_us":87,"threads_started":1}
I20260812 06:26:05.651031 23455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b1d220ec5544feeae6cd5385e466472" candidate_uuid: "e4aaf796e0dc442cbf8c7899139e4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae8599ec463c4e128f6a829e390acadb"
I20260812 06:26:05.651122 23455 raft_consensus.cc:3037] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:05.651177 23695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b1d220ec5544feeae6cd5385e466472" candidate_uuid: "e4aaf796e0dc442cbf8c7899139e4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365e30b7742440259c32f2d3ece16aea" is_pre_election: true
I20260812 06:26:05.651346 23710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b1d220ec5544feeae6cd5385e466472" candidate_uuid: "e4aaf796e0dc442cbf8c7899139e4348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365e30b7742440259c32f2d3ece16aea"
I20260812 06:26:05.651335 23695 raft_consensus.cc:2454] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4aaf796e0dc442cbf8c7899139e4348 in term 0.
I20260812 06:26:05.652822 23455 raft_consensus.cc:2454] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4aaf796e0dc442cbf8c7899139e4348 in term 1.
I20260812 06:26:05.653021 23090 leader_election.cc:302] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae8599ec463c4e128f6a829e390acadb, e4aaf796e0dc442cbf8c7899139e4348; no voters: 365e30b7742440259c32f2d3ece16aea
I20260812 06:26:05.653177 23885 raft_consensus.cc:2781] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:26:05.653334 23885 raft_consensus.cc:686] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [term 1 LEADER]: Becoming Leader. State: Replica: e4aaf796e0dc442cbf8c7899139e4348, State: Running, Role: LEADER
I20260812 06:26:05.653420 23885 consensus_queue.cc:237] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae8599ec463c4e128f6a829e390acadb" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34833 } } peers { permanent_uuid: "e4aaf796e0dc442cbf8c7899139e4348" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34513 } } peers { permanent_uuid: "365e30b7742440259c32f2d3ece16aea" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44119 } }
I20260812 06:26:05.654238 22924 catalog_manager.cc:5495] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4aaf796e0dc442cbf8c7899139e4348 (127.30.15.65). New cstate: current_term: 1 leader_uuid: "e4aaf796e0dc442cbf8c7899139e4348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae8599ec463c4e128f6a829e390acadb" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4aaf796e0dc442cbf8c7899139e4348" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365e30b7742440259c32f2d3ece16aea" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44119 } health_report { overall_health: UNKNOWN } } }
I20260812 06:26:05.726209 23867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.723018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43692 (local address 127.30.15.65:34513)
0812 06:26:05.723084 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:05.723087 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:05.723096 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:26:05.723140 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:05.723141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:05.723163 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:05.723237 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:26:05.723430 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.724140 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.725282 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:05.725610 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:05.725681 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:05.725860 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:26:05.725989 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:26:05.726081 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:05.726105 (+ 24us) server_negotiation.cc:299] Negotiation successful
0812 06:26:05.726129 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260812 06:26:05.728307 23695 raft_consensus.cc:3037] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:05.728644 23455 raft_consensus.cc:1261] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb [term 1 FOLLOWER]: Refusing update from remote peer e4aaf796e0dc442cbf8c7899139e4348: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:26:05.728963 23885 consensus_queue.cc:1035] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae8599ec463c4e128f6a829e390acadb" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:26:05.729334 23695 raft_consensus.cc:1261] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea [term 1 FOLLOWER]: Refusing update from remote peer e4aaf796e0dc442cbf8c7899139e4348: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:26:05.729727 23885 consensus_queue.cc:1035] T 0b1d220ec5544feeae6cd5385e466472 P e4aaf796e0dc442cbf8c7899139e4348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "365e30b7742440259c32f2d3ece16aea" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 44119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:26:05.732903 23904 mvcc.cc:205] Tried to move back new op lower bound from 7317569395620892672 to 7317569395317030912. Current Snapshot: MvccSnapshot[applied={T|T < 7317569395620892672 or (T in {7317569395620892672})}]
I20260812 06:26:05.732962 23902 mvcc.cc:205] Tried to move back new op lower bound from 7317569395620892672 to 7317569395317030912. Current Snapshot: MvccSnapshot[applied={T|T < 7317569395620892672}]
I20260812 06:26:05.733089 23901 mvcc.cc:205] Tried to move back new op lower bound from 7317569395620892672 to 7317569395317030912. Current Snapshot: MvccSnapshot[applied={T|T < 7317569395620892672}]
I20260812 06:26:05.737502 22927 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:26:05.737615 22927 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:26:05.738373 22927 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bac8686f4c944459a1eb3e704a643c17: Sending DeleteTablet for 3 replicas of tablet 0b1d220ec5544feeae6cd5385e466472
I20260812 06:26:05.738729 23421 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b1d220ec5544feeae6cd5385e466472 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:05 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:33446
I20260812 06:26:05.739094 23176 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b1d220ec5544feeae6cd5385e466472 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:05 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:43688
I20260812 06:26:05.739125 23635 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b1d220ec5544feeae6cd5385e466472 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:05 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:41086
I20260812 06:26:05.739588 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 22990
I20260812 06:26:05.751211 23916 tablet_replica.cc:330] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea: stopping tablet replica
I20260812 06:26:05.751367 23916 raft_consensus.cc:2229] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:26:05.751492 23916 raft_consensus.cc:2258] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:05.752632 23913 tablet_replica.cc:330] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb: stopping tablet replica
I20260812 06:26:05.752766 23913 raft_consensus.cc:2229] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:26:05.752885 23913 raft_consensus.cc:2258] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:05.753019 23916 ts_tablet_manager.cc:1905] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:26:05.753384 23913 ts_tablet_manager.cc:1905] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:26:05.754621 23916 ts_tablet_manager.cc:1918] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:26:05.754731 23916 log.cc:1196] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/0b1d220ec5544feeae6cd5385e466472
I20260812 06:26:05.755029 23916 ts_tablet_manager.cc:1939] T 0b1d220ec5544feeae6cd5385e466472 P 365e30b7742440259c32f2d3ece16aea: Deleting consensus metadata
I20260812 06:26:05.755136 23913 ts_tablet_manager.cc:1918] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:26:05.755282 23913 log.cc:1196] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/0b1d220ec5544feeae6cd5385e466472
I20260812 06:26:05.755506 22896 catalog_manager.cc:4841] TS 365e30b7742440259c32f2d3ece16aea (127.30.15.67:44119): tablet 0b1d220ec5544feeae6cd5385e466472 (table test-table [id=91ebf252264a4d2ab64ae9a6b484d8da]) successfully deleted
I20260812 06:26:05.755625 23913 ts_tablet_manager.cc:1939] T 0b1d220ec5544feeae6cd5385e466472 P ae8599ec463c4e128f6a829e390acadb: Deleting consensus metadata
I20260812 06:26:05.756067 22897 catalog_manager.cc:4841] TS ae8599ec463c4e128f6a829e390acadb (127.30.15.66:34833): tablet 0b1d220ec5544feeae6cd5385e466472 (table test-table [id=91ebf252264a4d2ab64ae9a6b484d8da]) successfully deleted
W20260812 06:26:05.758627 22896 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:34513 (error 108)
I20260812 06:26:05.759660 23872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:05.759513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:34513 (local address 127.0.0.1:43700)
0812 06:26:05.759567 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:05.759624 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:34513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260812 06:26:05.759658 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 23299
W20260812 06:26:05.761739 22896 catalog_manager.cc:4584] TS e4aaf796e0dc442cbf8c7899139e4348 (127.30.15.65:34513): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0b1d220ec5544feeae6cd5385e466472: Network error: Client connection negotiation failed: client connection to 127.30.15.65:34513: connect: Connection refused (error 111)
I20260812 06:26:05.773469 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 23548
I20260812 06:26:05.812944 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 22869
I20260812 06:26:05.829128 30781 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 06:26:06.175139 30781 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 06:26:06.175477 30781 mini_ranger.cc:66] Stopping Ranger...
I20260812 06:26:06.529464 30781 mini_ranger.cc:68] Stopped Ranger
2026-08-12 06:26:06.529 UTC [20986] LOG: received smart shutdown request
2026-08-12 06:26:06.534 UTC [20986] LOG: background worker "logical replication launcher" (PID 21004) exited with exit code 1
2026-08-12 06:26:06.534 UTC [20994] LOG: shutting down
2026-08-12 06:26:06.657 UTC [20986] LOG: database system is shut down
2026-08-12T06:26:06Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47170 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:26:06 dist-test-slave-gjrz krb5kdc[23948](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:26:06 dist-test-slave-gjrz krb5kdc[23948](info): set up 2 sockets
Aug 12 06:26:06 dist-test-slave-gjrz krb5kdc[23948](info): commencing operation
krb5kdc: starting...
W20260812 06:26:07.935849 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:26:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:26:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:26:08.048120 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:38851
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:38851,127.30.15.125:39245,127.30.15.124:42443
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:08.127190 23988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:08.127419 23988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:08.127444 23988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:08.128543 23988 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:26:08.128582 23988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:08.128594 23988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:08.128618 23988 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:26:08.128641 23988 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:26:08.130095 23988 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:38851,127.30.15.125:39245,127.30.15.124:42443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:38851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:08.130317 23988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:08.130518 23988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:08.135193 24002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:08.135206 24004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:08.135205 23999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:08.135458 23988 server_base.cc:1034] running on GCE node
I20260812 06:26:08.135684 23988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:08.135947 23988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:08.137091 23988 hybrid_clock.cc:648] HybridClock initialized: now 1786515968137072 us; error 32 us; skew 500 ppm
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:08.139487 23988 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:26:08.139871 23988 webserver.cc:460] Webserver started at http://127.30.15.126:37753/ using document root <none> and password file <none>
I20260812 06:26:08.140079 23988 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:08.140125 23988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:08.140240 23988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:26:08.141196 23988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "e8c903f2d38641e488b78b05dd250b8d"
format_stamp: "Formatted at 2026-08-12 06:26:08 on dist-test-slave-gjrz"
server_key: "4724bba0944bd029ffa180c7feb5c917"
server_key_iv: "43495c384c01907ceda697c39f580963"
server_key_version: "encryptionkey@0"
I20260812 06:26:08.141510 23988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "e8c903f2d38641e488b78b05dd250b8d"
format_stamp: "Formatted at 2026-08-12 06:26:08 on dist-test-slave-gjrz"
server_key: "4724bba0944bd029ffa180c7feb5c917"
server_key_iv: "43495c384c01907ceda697c39f580963"
server_key_version: "encryptionkey@0"
I20260812 06:26:08.142724 23988 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:26:08.143362 24018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:08.143503 23988 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:08.143585 23988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "e8c903f2d38641e488b78b05dd250b8d"
format_stamp: "Formatted at 2026-08-12 06:26:08 on dist-test-slave-gjrz"
server_key: "4724bba0944bd029ffa180c7feb5c917"
server_key_iv: "43495c384c01907ceda697c39f580963"
server_key_version: "encryptionkey@0"
I20260812 06:26:08.143652 23988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:08.168546 23988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:08.170163 23988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:08.170290 23988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:08.173961 23988 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:38851
I20260812 06:26:08.173995 24123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:38851 every 8 connection(s)
I20260812 06:26:08.174295 23988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:26:08.175089 24124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:08.176565 24124 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:08.182408 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 23988
I20260812 06:26:08.182505 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:26:08.182713 30781 external_mini_cluster.cc:1428] Setting key 6d0e918abe61fa03d58baaedd49fe33d
I20260812 06:26:08.185355 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.177161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:38851 (local address 127.0.0.1:51132)
0812 06:26:08.177308 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.177346 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:08.177786 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:08.178000 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:08.178002 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:08.178226 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:08.178373 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.178377 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.179323 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.179324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.180010 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.180011 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.180434 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.180435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.180498 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.180923 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:08.180937 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:08.182213 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:08.183982 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.183989 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.183990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.184186 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.184430 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.184431 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.184431 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.184500 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.184832 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:08.184837 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:08.184891 (+ 54us) client_negotiation.cc:769] Sending connection context
0812 06:26:08.184966 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 06:26:08.185185 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":91,"thread_start_us":65,"threads_started":1}
I20260812 06:26:08.185359 24129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.177195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51132 (local address 127.30.15.126:38851)
0812 06:26:08.177350 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.177359 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.177432 (+ 73us) server_negotiation.cc:407] Connection header received
0812 06:26:08.177894 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.177896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.177912 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.177981 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.178452 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.179231 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.180072 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.180376 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.180455 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.182296 (+ 1841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.182303 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.182304 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.182309 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.183908 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.184257 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.184260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.184260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.184362 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.184572 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.184572 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.184573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.184770 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.184841 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.185001 (+ 160us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.185113 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":73,"threads_started":1}
I20260812 06:26:08.186151 24124 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:26:08.186450 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.186342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:39245 (local address 127.0.0.1:43950)
0812 06:26:08.186381 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.186424 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:39245: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 06:26:08.186575 24022 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.15.125:39245: connect: Connection refused (error 111)
I20260812 06:26:08.186964 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.186879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:39245 (local address 127.0.0.1:43952)
0812 06:26:08.186918 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.186942 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:39245: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 06:26:08.187079 24124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.125:39245: Network error: Client connection negotiation failed: client connection to 127.30.15.125:39245: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.30.15.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.125.keytab.
Entry for principal kudu/127.30.15.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.125.keytab.
I20260812 06:26:08.205855 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.125:39245
--webserver_interface=127.30.15.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.125.keytab
--principal=kudu/127.30.15.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:38851,127.30.15.125:39245,127.30.15.124:42443
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:26:08.236260 24124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } attempt: 1
I20260812 06:26:08.236675 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.236561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:39245 (local address 127.0.0.1:43962)
0812 06:26:08.236614 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.236644 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:39245: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 06:26:08.237001 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.236912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:39245 (local address 127.0.0.1:43964)
0812 06:26:08.236957 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.236981 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:39245: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 06:26:08.237103 24124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.125:39245: Network error: Client connection negotiation failed: client connection to 127.30.15.125:39245: connect: Connection refused (error 111)
W20260812 06:26:08.285135 24136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:08.285321 24136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:08.285342 24136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:08.286384 24136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:26:08.286417 24136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:08.286430 24136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:08.286440 24136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:26:08.286458 24136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:26:08.287916 24136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:38851,127.30.15.125:39245,127.30.15.124:42443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.125.keytab
--principal=kudu/127.30.15.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.125:39245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.15.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:08.288112 24136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:08.288278 24136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:08.292789 24141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:08.292768 24146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:08.292868 24136 server_base.cc:1034] running on GCE node
W20260812 06:26:08.292773 24142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:08.293234 24136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:08.293499 24136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:08.294657 24136 hybrid_clock.cc:648] HybridClock initialized: now 1786515968294641 us; error 24 us; skew 500 ppm
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:08.297176 24136 init.cc:377] Logged in from keytab as kudu/127.30.15.125@KRBTEST.COM (short username kudu)
I20260812 06:26:08.297580 24136 webserver.cc:460] Webserver started at http://127.30.15.125:46201/ using document root <none> and password file <none>
I20260812 06:26:08.297788 24136 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:08.297842 24136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:08.297961 24136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:26:08.298967 24136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/data/instance:
uuid: "877093f868174894b756de52e8c00f9b"
format_stamp: "Formatted at 2026-08-12 06:26:08 on dist-test-slave-gjrz"
server_key: "1bb8a7ba404b6edc846d23cd5c88e7ef"
server_key_iv: "32fcb4ce5635015efaad8c7fb78c2043"
server_key_version: "encryptionkey@0"
I20260812 06:26:08.299343 24136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/wal/instance:
uuid: "877093f868174894b756de52e8c00f9b"
format_stamp: "Formatted at 2026-08-12 06:26:08 on dist-test-slave-gjrz"
server_key: "1bb8a7ba404b6edc846d23cd5c88e7ef"
server_key_iv: "32fcb4ce5635015efaad8c7fb78c2043"
server_key_version: "encryptionkey@0"
I20260812 06:26:08.300542 24136 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:26:08.301201 24158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:08.301348 24136 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:26:08.301430 24136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/wal
uuid: "877093f868174894b756de52e8c00f9b"
format_stamp: "Formatted at 2026-08-12 06:26:08 on dist-test-slave-gjrz"
server_key: "1bb8a7ba404b6edc846d23cd5c88e7ef"
server_key_iv: "32fcb4ce5635015efaad8c7fb78c2043"
server_key_version: "encryptionkey@0"
I20260812 06:26:08.301496 24136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:08.305248 24124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } attempt: 2
I20260812 06:26:08.305608 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.305473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:39245 (local address 127.0.0.1:43968)
0812 06:26:08.305527 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.305572 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:39245: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:26:08.305899 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.305834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:39245 (local address 127.0.0.1:43984)
0812 06:26:08.305864 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.305885 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:39245: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260812 06:26:08.305977 24124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.125:39245: Network error: Client connection negotiation failed: client connection to 127.30.15.125:39245: connect: Connection refused (error 111)
I20260812 06:26:08.313603 24136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:08.315295 24136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:08.315434 24136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:08.319406 24136 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.125:39245
I20260812 06:26:08.319458 24266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.125:39245 every 8 connection(s)
I20260812 06:26:08.319766 24136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
I20260812 06:26:08.319938 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 24136
I20260812 06:26:08.320062 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-1/wal/instance
I20260812 06:26:08.320293 30781 external_mini_cluster.cc:1428] Setting key 31928d906a6144f6ae4709e776a2cdc5
I20260812 06:26:08.320818 24269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:08.322700 24269 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.30.15.124@KRBTEST.COM; defaulting to no policy
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.125@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.124@KRBTEST.COM" created.
I20260812 06:26:08.331480 24129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.323362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51134 (local address 127.30.15.126:38851)
0812 06:26:08.323418 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.323420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.323616 (+ 196us) server_negotiation.cc:407] Connection header received
0812 06:26:08.324050 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.324052 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.324065 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.324134 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.324775 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.325538 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.326525 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.326838 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.326913 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.328981 (+ 2068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.328983 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.328983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.328989 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.330113 (+ 1124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.330511 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.330512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.330512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.330570 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.330818 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.330819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.330819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.330930 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.330989 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.331316 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.331397 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:26:08.331593 24274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.323348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:38851 (local address 127.0.0.1:51134)
0812 06:26:08.323492 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.323541 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:08.323965 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:08.324192 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:08.324195 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:08.324429 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:08.324677 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.324683 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.325639 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.325640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.326438 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.326440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.326917 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.326918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.327015 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.327558 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:08.327566 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:08.328888 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:08.330176 (+ 1288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.330183 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.330185 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.330454 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.330619 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.330620 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.330620 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.330755 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.330992 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:08.330999 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:08.331158 (+ 159us) client_negotiation.cc:769] Sending connection context
0812 06:26:08.331255 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 06:26:08.331410 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":73,"threads_started":1}
I20260812 06:26:08.332190 24269 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.125@KRBTEST.COM for kudu/127.30.15.125@KRBTEST.COM
I20260812 06:26:08.338937 24274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.332432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:39245 (local address 127.0.0.1:43994)
0812 06:26:08.332476 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.332485 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:08.332520 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:08.332789 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:08.332789 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:08.332927 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:08.332980 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.332981 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.333862 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.333862 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.334335 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.334336 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.334963 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.334964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.335034 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.335377 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:08.335381 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:08.336515 (+ 1134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:08.338003 (+ 1488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.338004 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.338005 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.338198 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.338418 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.338419 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.338420 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.338479 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.338718 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:08.338718 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:08.338755 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 06:26:08.338807 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 06:26:08.338879 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:26:08.339079 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.332501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43994 (local address 127.30.15.125:39245)
0812 06:26:08.332638 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.332643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.332663 (+ 20us) server_negotiation.cc:407] Connection header received
0812 06:26:08.332687 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.332689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.332702 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.332775 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.333065 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.333776 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.334409 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.334895 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.334967 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.336603 (+ 1636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.336610 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.336610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.336616 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.337923 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.338284 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.338287 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.338288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.338351 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.338543 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.338544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.338544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.338665 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.338723 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.338836 (+ 113us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.338935 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260812 06:26:08.339615 24269 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:26:08.339879 24274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.339787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:42443 (local address 127.0.0.1:51450)
0812 06:26:08.339823 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.339863 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260812 06:26:08.339991 24159 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
I20260812 06:26:08.340364 24274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.340286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:42443 (local address 127.0.0.1:51462)
0812 06:26:08.340320 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.340344 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260812 06:26:08.340446 24269 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:42443: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.124.keytab.
Entry for principal kudu/127.30.15.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.124.keytab.
I20260812 06:26:08.344045 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.124:42443
--webserver_interface=127.30.15.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.124.keytab
--principal=kudu/127.30.15.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:38851,127.30.15.125:39245,127.30.15.124:42443
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:26:08.389648 24269 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } attempt: 1
I20260812 06:26:08.390154 24274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.390016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:42443 (local address 127.0.0.1:51468)
0812 06:26:08.390082 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.390124 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 06:26:08.390472 24274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.390394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:42443 (local address 127.0.0.1:51470)
0812 06:26:08.390432 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.390455 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 06:26:08.390547 24269 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:42443: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
I20260812 06:26:08.397119 24124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } attempt: 3
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.125@KRBTEST.COM
I20260812 06:26:08.403862 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.397464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44000 (local address 127.30.15.125:39245)
0812 06:26:08.397507 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.397509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.397519 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:26:08.397598 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.397599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.397609 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.397665 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.398015 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.398491 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.399471 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.399682 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.399728 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.401624 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.401625 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.401625 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.401631 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.402841 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.403195 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.403196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.403196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.403239 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.403417 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.403417 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.403418 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.403515 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.403580 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.403719 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.403781 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:26:08.403887 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.397424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:39245 (local address 127.0.0.1:44000)
0812 06:26:08.397478 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.397488 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:08.397530 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:08.397684 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:08.397686 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:08.397868 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:08.397943 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.397946 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.398571 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.398573 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.399403 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.399407 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.399743 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.399744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.399826 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.400218 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:08.400223 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:08.401535 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:08.402915 (+ 1380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.402917 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.402917 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.403130 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.403302 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.403303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.403303 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.403366 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.403577 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:08.403578 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:08.403625 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 06:26:08.403690 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 06:26:08.403784 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 06:26:08.404237 24124 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:26:08.404572 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.404467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:42443 (local address 127.0.0.1:51480)
0812 06:26:08.404512 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.404542 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 06:26:08.404845 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.404756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:42443 (local address 127.0.0.1:51490)
0812 06:26:08.404796 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.404817 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 06:26:08.404928 24124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:42443: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
W20260812 06:26:08.426044 24286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:08.426244 24286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:08.426265 24286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:08.427412 24286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:26:08.427451 24286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:08.427464 24286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:08.427475 24286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:26:08.427500 24286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:26:08.429013 24286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:38851,127.30.15.125:39245,127.30.15.124:42443
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.124.keytab
--principal=kudu/127.30.15.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.124:42443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.15.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:08.429246 24286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:08.429453 24286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:26:08.434022 24286 server_base.cc:1034] running on GCE node
W20260812 06:26:08.434005 24295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:08.433993 24297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:08.434005 24300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:08.434538 24286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:08.434787 24286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:08.435916 24286 hybrid_clock.cc:648] HybridClock initialized: now 1786515968435901 us; error 26 us; skew 500 ppm
I20260812 06:26:08.436059 24124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } attempt: 1
I20260812 06:26:08.436414 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.436276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:42443 (local address 127.0.0.1:51496)
0812 06:26:08.436338 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.436377 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 06:26:08.436710 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.436613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:42443 (local address 127.0.0.1:51504)
0812 06:26:08.436657 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.436684 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260812 06:26:08.436795 24124 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:42443: Network error: Client connection negotiation failed: client connection to 127.30.15.124:42443: connect: Connection refused (error 111)
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:08.438328 24286 init.cc:377] Logged in from keytab as kudu/127.30.15.124@KRBTEST.COM (short username kudu)
I20260812 06:26:08.438751 24286 webserver.cc:460] Webserver started at http://127.30.15.124:41113/ using document root <none> and password file <none>
I20260812 06:26:08.438970 24286 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:08.439021 24286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:08.439143 24286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:26:08.440178 24286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/data/instance:
uuid: "6c8a5a692179412fa7aafcffda40ccb2"
format_stamp: "Formatted at 2026-08-12 06:26:08 on dist-test-slave-gjrz"
server_key: "a456aca1348e0e6f408443c9261712af"
server_key_iv: "aeaae8617b4dacdb81d32b35c0e613a9"
server_key_version: "encryptionkey@0"
I20260812 06:26:08.440511 24286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/wal/instance:
uuid: "6c8a5a692179412fa7aafcffda40ccb2"
format_stamp: "Formatted at 2026-08-12 06:26:08 on dist-test-slave-gjrz"
server_key: "a456aca1348e0e6f408443c9261712af"
server_key_iv: "aeaae8617b4dacdb81d32b35c0e613a9"
server_key_version: "encryptionkey@0"
I20260812 06:26:08.441702 24286 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:26:08.442333 24313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:08.442474 24286 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:26:08.442564 24286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/wal
uuid: "6c8a5a692179412fa7aafcffda40ccb2"
format_stamp: "Formatted at 2026-08-12 06:26:08 on dist-test-slave-gjrz"
server_key: "a456aca1348e0e6f408443c9261712af"
server_key_iv: "aeaae8617b4dacdb81d32b35c0e613a9"
server_key_version: "encryptionkey@0"
I20260812 06:26:08.442627 24286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:08.451016 24286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:08.452968 24286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:08.453096 24286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:08.456964 24286 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.124:42443
I20260812 06:26:08.456995 24416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.124:42443 every 8 connection(s)
I20260812 06:26:08.457302 24286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
I20260812 06:26:08.458096 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 24286
I20260812 06:26:08.458168 24417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:08.458222 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786515816548244-30781-0/minicluster-data/master-2/wal/instance
I20260812 06:26:08.458415 30781 external_mini_cluster.cc:1428] Setting key 8e7c868b1ea424456aae69e30c3d3885
I20260812 06:26:08.458678 24269 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } attempt: 2
I20260812 06:26:08.460695 24417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.125@KRBTEST.COM for kudu/127.30.15.124@KRBTEST.COM
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.124@KRBTEST.COM
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.124@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:08.468617 24274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.458918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:42443 (local address 127.0.0.1:51526)
0812 06:26:08.458967 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.458977 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:08.459014 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:08.460029 (+ 1015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:08.460030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:08.460210 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:08.460269 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.460272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.461743 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.461745 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.462251 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.462252 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.462903 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.462905 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.462969 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.463622 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:08.463627 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:08.465019 (+ 1392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:08.467038 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.467039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.467040 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.467282 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.467579 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.467581 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.467581 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.467654 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.468297 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:08.468298 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:08.468348 (+ 50us) client_negotiation.cc:769] Sending connection context
0812 06:26:08.468413 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 06:26:08.468511 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 06:26:08.468941 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.458886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51516 (local address 127.30.15.124:42443)
0812 06:26:08.459132 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.459141 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.459174 (+ 33us) server_negotiation.cc:407] Connection header received
0812 06:26:08.459777 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.459786 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.459845 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.460597 (+ 752us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.460626 (+ 29us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.461660 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.462652 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.462925 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.463236 (+ 311us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.465688 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.465689 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.465689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.465696 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.467661 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.467951 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.467952 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.467952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.468014 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.468240 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.468240 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.468241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.468348 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.468463 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.468586 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.468718 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":196,"thread_start_us":71,"threads_started":1}
I20260812 06:26:08.468947 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.459125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51526 (local address 127.30.15.124:42443)
0812 06:26:08.459298 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.459300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.459309 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:26:08.459798 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.459800 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.459847 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.460381 (+ 534us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.460498 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.461658 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.462320 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.462822 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.462922 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.465109 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.465117 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.465118 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.465125 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.466947 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.467376 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.467379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.467379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.467490 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.467965 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.467966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.467966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.468237 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.468313 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.468735 (+ 422us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.468811 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":223,"server-negotiator.queue_time_us":128,"thread_start_us":89,"threads_started":1}
I20260812 06:26:08.469404 24129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.461387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51144 (local address 127.30.15.126:38851)
0812 06:26:08.461439 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.461441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.461529 (+ 88us) server_negotiation.cc:407] Connection header received
0812 06:26:08.461629 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.461631 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.461640 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.461873 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.462468 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.463045 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.463925 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.464128 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.464190 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.466279 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.466280 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.466280 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.466289 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.467929 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.468376 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.468377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.468377 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.468433 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.468625 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.468626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.468626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.468749 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.468791 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.469249 (+ 458us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.469318 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:26:08.469446 24426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.461297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:38851 (local address 127.0.0.1:51144)
0812 06:26:08.461433 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.461472 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:08.461564 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:08.461981 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:08.461984 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:08.462301 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:08.462377 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.462379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.463120 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.463121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.463843 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.463846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.464205 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.464206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.464286 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.464684 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:08.464691 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:08.466164 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:08.468029 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.468037 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.468039 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.468295 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.468502 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.468503 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.468503 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.468560 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.469040 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:08.469046 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:08.469107 (+ 61us) client_negotiation.cc:769] Sending connection context
0812 06:26:08.469215 (+ 108us) client_negotiation.cc:240] Negotiation successful
0812 06:26:08.469320 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":4,"thread_start_us":80,"threads_started":1}
I20260812 06:26:08.469873 24417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:26:08.470606 24269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b: Bootstrap starting.
I20260812 06:26:08.471479 24269 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:08.471752 24269 log.cc:824] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:08.472816 24269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b: No bootstrap required, opened a new log
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.124@KRBTEST.COM for kudu/127.30.15.125@KRBTEST.COM
I20260812 06:26:08.474789 24269 raft_consensus.cc:348] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } }
I20260812 06:26:08.474944 24269 raft_consensus.cc:374] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:08.474982 24269 raft_consensus.cc:729] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 877093f868174894b756de52e8c00f9b, State: Initialized, Role: FOLLOWER
I20260812 06:26:08.475137 24269 consensus_queue.cc:260] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } }
I20260812 06:26:08.475473 24269 sys_catalog.cc:564] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:26:08.476176 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.470133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44002 (local address 127.30.15.125:39245)
0812 06:26:08.470169 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.470170 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.470178 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:26:08.470218 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.470219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.470227 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.470277 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.470515 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.471002 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.471696 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.471925 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.471980 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.473750 (+ 1770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.473751 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.473752 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.473758 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.475104 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.475461 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.475462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.475463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.475519 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.475708 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.475709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.475710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.475835 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.475891 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.476020 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.476092 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:26:08.476176 24426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.470081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:39245 (local address 127.0.0.1:44002)
0812 06:26:08.470120 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.470130 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:08.470171 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:08.470281 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:08.470282 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:08.470405 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:08.470452 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.470453 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.471076 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.471077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.471621 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.471623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.471982 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.471983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.472062 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.472391 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:08.472396 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:08.473656 (+ 1260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:08.475168 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.475169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.475170 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.475396 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.475599 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.475600 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.475600 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.475654 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.475895 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:08.475896 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:08.475937 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 06:26:08.475999 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:26:08.476086 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:08.476614 24417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:26:08.477049 24429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } } }
I20260812 06:26:08.477450 24429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:26:08.477785 24448 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:26:08.477876 24448 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.124@KRBTEST.COM for kudu/127.30.15.124@KRBTEST.COM
I20260812 06:26:08.477891 24136 master_runner.cc:186] Error getting master registration for 127.30.15.126:38851: OK, instance_id { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" instance_seqno: 1786515968172980 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:26:08.480573 24136 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:26:08.482895 24426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.476822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:42443 (local address 127.0.0.1:51536)
0812 06:26:08.477274 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.477283 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:08.477327 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:08.477660 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:08.477661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:08.477791 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:08.477827 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.477829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.478443 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.478444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.478908 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.478910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.479255 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.479256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.479322 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.479634 (+ 312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:08.479638 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:08.480640 (+ 1002us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:08.481961 (+ 1321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.481961 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.481962 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.482149 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.482329 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.482330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.482330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.482381 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.482615 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:08.482616 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:08.482652 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:26:08.482713 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:26:08.482803 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442}
I20260812 06:26:08.482955 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.477184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51536 (local address 127.30.15.124:42443)
0812 06:26:08.477253 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.477255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.477556 (+ 301us) server_negotiation.cc:407] Connection header received
0812 06:26:08.477578 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.477578 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.477588 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.477629 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.477903 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.478369 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.478977 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.479198 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.479250 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.480705 (+ 1455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.480706 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.480707 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.480713 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.481886 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.482228 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.482229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.482229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.482278 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.482432 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.482432 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.482432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.482551 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.482612 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.482738 (+ 126us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.482855 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":51}
I20260812 06:26:08.483137 24129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.469744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51148 (local address 127.30.15.126:38851)
0812 06:26:08.469778 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.469779 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.472032 (+ 2253us) server_negotiation.cc:407] Connection header received
0812 06:26:08.472089 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.472090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.472100 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.472155 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.472568 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.473136 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.473842 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.474119 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.474184 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.476683 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.476685 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.476685 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.476692 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.481307 (+ 4615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.482201 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.482202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.482202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.482260 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.482486 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.482487 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.482487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.482607 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.482743 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.482973 (+ 230us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.483050 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:26:08.484392 24417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2: Bootstrap starting.
I20260812 06:26:08.484970 24417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:08.485236 24417 log.cc:824] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:08.486035 24417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2: No bootstrap required, opened a new log
I20260812 06:26:08.488023 24417 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } }
I20260812 06:26:08.488185 24417 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:08.488479 24417 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c8a5a692179412fa7aafcffda40ccb2, State: Initialized, Role: FOLLOWER
I20260812 06:26:08.488631 24417 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } }
I20260812 06:26:08.488947 24417 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:26:08.488922 24455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } } }
I20260812 06:26:08.489118 24455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [sys.catalog]: This master's current role is: FOLLOWER
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.125@KRBTEST.COM
W20260812 06:26:08.491367 24485 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:26:08.491456 24485 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:26:08.493103 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.484267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44016 (local address 127.30.15.125:39245)
0812 06:26:08.485463 (+ 1196us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.485465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.485473 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:26:08.485489 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.485489 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.485496 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.485547 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.486099 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.486740 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.487703 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.487966 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.488025 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.490447 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.490448 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.490448 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.490454 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.491911 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.492270 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.492271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.492272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.492323 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.492510 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.492510 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.492511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.492635 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.492741 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.492945 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.493020 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1179}
I20260812 06:26:08.491485 24286 master_runner.cc:186] Error getting master registration for 127.30.15.126:38851: OK, instance_id { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" instance_seqno: 1786515968172980 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:26:08.493628 24286 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:26:08.494562 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:26:08.503885 24129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.496176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51154 (local address 127.30.15.126:38851)
0812 06:26:08.496241 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.496243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.496252 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:26:08.496271 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.496272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.496280 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.496341 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.497114 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.497788 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.498794 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.499064 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.499099 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.500750 (+ 1651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.500751 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.500751 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.500758 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.502741 (+ 1983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.503083 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.503084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.503084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.503139 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.503351 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.503351 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.503352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.503468 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.503531 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.503729 (+ 198us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.503803 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 06:26:08.504367 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.495969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44018 (local address 127.30.15.125:39245)
0812 06:26:08.496002 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.496003 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.496220 (+ 217us) server_negotiation.cc:407] Connection header received
0812 06:26:08.496267 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.496268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.496277 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.496323 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.497044 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.497738 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.498735 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.499004 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.499037 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.500570 (+ 1533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.500571 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.500571 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.500578 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.502390 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.503531 (+ 1141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.503532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.503532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.503616 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.503820 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.503821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.503821 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.503931 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.503995 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.504227 (+ 232us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.504289 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:26:08.508500 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.496195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51552 (local address 127.30.15.124:42443)
0812 06:26:08.496381 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.496382 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.496390 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:26:08.497963 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.497964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.497974 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.498001 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.500988 (+ 2987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.501648 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.505053 (+ 3405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.505296 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.505326 (+ 30us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.506346 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.506347 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.506348 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.506354 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.507557 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.507843 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.507844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.507845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.507896 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.508063 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.508064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.508064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.508159 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.508236 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.508358 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.508420 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168}
I20260812 06:26:08.511919 24124 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } attempt: 2
Aug 12 06:26:08 dist-test-slave-gjrz krb5kdc[23948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515968, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.124@KRBTEST.COM
I20260812 06:26:08.517967 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.512153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51558 (local address 127.30.15.124:42443)
0812 06:26:08.512182 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:08.512183 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:08.512204 (+ 21us) server_negotiation.cc:407] Connection header received
0812 06:26:08.512258 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:08.512259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:08.512267 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:08.512311 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:08.512532 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.512941 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.513721 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.513963 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.514016 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.515529 (+ 1513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:08.515530 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:08.515530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:08.515537 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:08.517002 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.517327 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.517328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.517328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.517380 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:08.517534 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:08.517535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:08.517535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:08.517637 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:08.517688 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:08.517818 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 06:26:08.517883 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 06:26:08.517971 24126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:08.512124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:42443 (local address 127.0.0.1:51558)
0812 06:26:08.512166 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:08.512176 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:08.512218 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:08.512316 (+ 98us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:08.512317 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:08.512439 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:08.512471 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.512472 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.513004 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.513005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.513665 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:08.513667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:08.514016 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:08.514017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:08.514069 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:08.514380 (+ 311us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:08.514384 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:08.515455 (+ 1071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:08.517087 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.517088 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.517088 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.517252 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.517433 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:08.517434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:08.517434 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:08.517485 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:08.517691 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:08.517692 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:08.517732 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 06:26:08.517791 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:26:08.517883 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:26:08.519541 24124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d: Bootstrap starting.
I20260812 06:26:08.520133 24124 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:08.520393 24124 log.cc:824] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:08.521090 24124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d: No bootstrap required, opened a new log
I20260812 06:26:08.522818 24124 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } }
I20260812 06:26:08.522921 24124 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:08.522953 24124 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8c903f2d38641e488b78b05dd250b8d, State: Initialized, Role: FOLLOWER
I20260812 06:26:08.523104 24124 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } }
I20260812 06:26:08.523366 24506 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } } }
I20260812 06:26:08.523422 24124 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:26:08.523499 24506 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:26:08.525704 24530 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:26:08.525871 24530 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:26:08.527181 23988 master_runner.cc:263] No leader master found from master e8c903f2d38641e488b78b05dd250b8d
I20260812 06:26:08.527228 23988 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 06:26:08.566025 24172 tablet.cc:2369] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:26:08.580269 24455 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:26:08.580372 24455 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } }
I20260812 06:26:08.580575 24455 leader_election.cc:288] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8c903f2d38641e488b78b05dd250b8d (127.30.15.126:38851), 877093f868174894b756de52e8c00f9b (127.30.15.125:39245)
I20260812 06:26:08.581048 24065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c8a5a692179412fa7aafcffda40ccb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8c903f2d38641e488b78b05dd250b8d" is_pre_election: true
I20260812 06:26:08.581193 24065 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c8a5a692179412fa7aafcffda40ccb2 in term 0.
I20260812 06:26:08.581485 24315 leader_election.cc:302] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c8a5a692179412fa7aafcffda40ccb2, e8c903f2d38641e488b78b05dd250b8d; no voters:
I20260812 06:26:08.581692 24455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:26:08.581749 24455 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:26:08.581771 24455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:08.582660 24455 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } }
I20260812 06:26:08.582777 24455 leader_election.cc:288] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [CANDIDATE]: Term 1 election: Requested vote from peers e8c903f2d38641e488b78b05dd250b8d (127.30.15.126:38851), 877093f868174894b756de52e8c00f9b (127.30.15.125:39245)
I20260812 06:26:08.583339 24211 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c8a5a692179412fa7aafcffda40ccb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "877093f868174894b756de52e8c00f9b"
I20260812 06:26:08.583441 24211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:08.584349 24211 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c8a5a692179412fa7aafcffda40ccb2 in term 1.
I20260812 06:26:08.583196 24212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c8a5a692179412fa7aafcffda40ccb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "877093f868174894b756de52e8c00f9b" is_pre_election: true
I20260812 06:26:08.584474 24212 raft_consensus.cc:2362] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6c8a5a692179412fa7aafcffda40ccb2 in term 1. Re-sending same reply.
I20260812 06:26:08.584719 24065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c8a5a692179412fa7aafcffda40ccb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8c903f2d38641e488b78b05dd250b8d"
I20260812 06:26:08.584789 24065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:08.585530 24065 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c8a5a692179412fa7aafcffda40ccb2 in term 1.
I20260812 06:26:08.585840 24317 leader_election.cc:302] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c8a5a692179412fa7aafcffda40ccb2, 877093f868174894b756de52e8c00f9b; no voters:
I20260812 06:26:08.586798 24455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:26:08.586970 24455 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [term 1 LEADER]: Becoming Leader. State: Replica: 6c8a5a692179412fa7aafcffda40ccb2, State: Running, Role: LEADER
I20260812 06:26:08.587064 24455 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } }
I20260812 06:26:08.587441 24455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c8a5a692179412fa7aafcffda40ccb2. Latest consensus state: current_term: 1 leader_uuid: "6c8a5a692179412fa7aafcffda40ccb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } } }
I20260812 06:26:08.587522 24455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:08.588296 24538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:26:08.588515 24538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:26:08.590000 24212 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [term 1 FOLLOWER]: Refusing update from remote peer 6c8a5a692179412fa7aafcffda40ccb2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:26:08.590363 24534 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:26:08.591691 24429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c8a5a692179412fa7aafcffda40ccb2. Latest consensus state: current_term: 1 leader_uuid: "6c8a5a692179412fa7aafcffda40ccb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } } }
I20260812 06:26:08.591794 24429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:26:08.592193 24065 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [term 1 FOLLOWER]: Refusing update from remote peer 6c8a5a692179412fa7aafcffda40ccb2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:26:08.592475 24534 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:26:08.593643 24506 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c8a5a692179412fa7aafcffda40ccb2. Latest consensus state: current_term: 1 leader_uuid: "6c8a5a692179412fa7aafcffda40ccb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } } }
I20260812 06:26:08.593734 24506 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:26:08.594667 24534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6c8a5a692179412fa7aafcffda40ccb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } } }
I20260812 06:26:08.594760 24534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:08.595227 24506 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6c8a5a692179412fa7aafcffda40ccb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } } }
I20260812 06:26:08.595321 24506 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:26:08.595577 24539 mvcc.cc:205] Tried to move back new op lower bound from 7317569407342563328 to 7317569407333175296. Current Snapshot: MvccSnapshot[applied={T|T < 7317569407342563328}]
I20260812 06:26:08.596171 24543 mvcc.cc:205] Tried to move back new op lower bound from 7317569407342563328 to 7317569407333175296. Current Snapshot: MvccSnapshot[applied={T|T < 7317569407342563328}]
I20260812 06:26:08.596694 24538 catalog_manager.cc:1347] Generated new cluster ID: 60ad1da21bf847a9964b0bd10fe61edf
I20260812 06:26:08.596738 24538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:26:08.599867 24455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6c8a5a692179412fa7aafcffda40ccb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } } }
I20260812 06:26:08.599941 24455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:08.600293 24429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6c8a5a692179412fa7aafcffda40ccb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c903f2d38641e488b78b05dd250b8d" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 38851 } } peers { permanent_uuid: "877093f868174894b756de52e8c00f9b" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 39245 } } peers { permanent_uuid: "6c8a5a692179412fa7aafcffda40ccb2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 42443 } } }
I20260812 06:26:08.600368 24429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:26:08.600586 24541 mvcc.cc:205] Tried to move back new op lower bound from 7317569407342563328 to 7317569407333175296. Current Snapshot: MvccSnapshot[applied={T|T < 7317569407342563328}]
I20260812 06:26:08.612950 24538 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:26:08.614502 24538 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:26:08.621949 24538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c8a5a692179412fa7aafcffda40ccb2: Generated new TSK 0
I20260812 06:26:08.622169 24538 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:26:09.478353 24448 catalog_manager.cc:1259] Loaded cluster ID: 60ad1da21bf847a9964b0bd10fe61edf
I20260812 06:26:09.478427 24448 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b: loading cluster ID for follower catalog manager: success
I20260812 06:26:09.479238 24448 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b: acquiring CA information for follower catalog manager: success
I20260812 06:26:09.479579 24448 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 877093f868174894b756de52e8c00f9b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:26:09.527941 24530 catalog_manager.cc:1259] Loaded cluster ID: 60ad1da21bf847a9964b0bd10fe61edf
I20260812 06:26:09.528004 24530 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d: loading cluster ID for follower catalog manager: success
I20260812 06:26:09.528802 24530 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d: acquiring CA information for follower catalog manager: success
I20260812 06:26:09.529134 24530 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e8c903f2d38641e488b78b05dd250b8d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:26:09.674803 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 23988
I20260812 06:26:09.690402 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 24136
I20260812 06:26:09.700673 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 24286
2026-08-12T06:26:09Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2959 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:26:09 dist-test-slave-gjrz krb5kdc[24568](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:26:09 dist-test-slave-gjrz krb5kdc[24568](info): set up 2 sockets
Aug 12 06:26:09 dist-test-slave-gjrz krb5kdc[24568](info): commencing operation
krb5kdc: starting...
W20260812 06:26:10.886663 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:26:10 dist-test-slave-gjrz krb5kdc[24568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:26:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:26:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:26:10.995802 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:45845
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:41491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:45845
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:11.074805 24589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:11.075004 24589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:11.075035 24589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:11.076175 24589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:26:11.076216 24589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:11.076236 24589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:11.076251 24589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:26:11.076267 24589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:26:11.077682 24589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:45845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:45845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:11.077917 24589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:11.078114 24589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:11.082763 24600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:11.082779 24606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:11.082866 24589 server_base.cc:1034] running on GCE node
W20260812 06:26:11.082779 24603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:11.083235 24589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:11.083545 24589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:11.084705 24589 hybrid_clock.cc:648] HybridClock initialized: now 1786515971084689 us; error 28 us; skew 500 ppm
Aug 12 06:26:11 dist-test-slave-gjrz krb5kdc[24568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515971, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:11.086997 24589 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:26:11.087406 24589 webserver.cc:460] Webserver started at http://127.30.15.126:46609/ using document root <none> and password file <none>
I20260812 06:26:11.087581 24589 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:11.087618 24589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:11.087702 24589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:26:11.088645 24589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "164caba835a5490698ff878e951cdba7"
format_stamp: "Formatted at 2026-08-12 06:26:11 on dist-test-slave-gjrz"
server_key: "482ec03faa4bf12c171306fb03b7c16c"
server_key_iv: "3a886bca401af15a475bbf0e923ea54c"
server_key_version: "encryptionkey@0"
I20260812 06:26:11.088933 24589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "164caba835a5490698ff878e951cdba7"
format_stamp: "Formatted at 2026-08-12 06:26:11 on dist-test-slave-gjrz"
server_key: "482ec03faa4bf12c171306fb03b7c16c"
server_key_iv: "3a886bca401af15a475bbf0e923ea54c"
server_key_version: "encryptionkey@0"
I20260812 06:26:11.090078 24589 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:26:11.090698 24620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:11.090880 24589 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:26:11.090965 24589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "164caba835a5490698ff878e951cdba7"
format_stamp: "Formatted at 2026-08-12 06:26:11 on dist-test-slave-gjrz"
server_key: "482ec03faa4bf12c171306fb03b7c16c"
server_key_iv: "3a886bca401af15a475bbf0e923ea54c"
server_key_version: "encryptionkey@0"
I20260812 06:26:11.091032 24589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:11.104486 24589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:11.106015 24589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:11.106130 24589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:11.110038 24589 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:45845
I20260812 06:26:11.110078 24712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:45845 every 8 connection(s)
I20260812 06:26:11.110368 24589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:26:11.111130 24717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:11.113276 24717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7: Bootstrap starting.
I20260812 06:26:11.113819 24717 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:11.114082 24717 log.cc:824] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:11.114739 24717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7: No bootstrap required, opened a new log
I20260812 06:26:11.116320 24717 raft_consensus.cc:348] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "164caba835a5490698ff878e951cdba7" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45845 } }
I20260812 06:26:11.116449 24717 raft_consensus.cc:374] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:11.116470 24717 raft_consensus.cc:729] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164caba835a5490698ff878e951cdba7, State: Initialized, Role: FOLLOWER
I20260812 06:26:11.116609 24717 consensus_queue.cc:260] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "164caba835a5490698ff878e951cdba7" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45845 } }
I20260812 06:26:11.116672 24717 raft_consensus.cc:388] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:26:11.116694 24717 raft_consensus.cc:482] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:26:11.116741 24717 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:11.117235 24717 raft_consensus.cc:504] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "164caba835a5490698ff878e951cdba7" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45845 } }
I20260812 06:26:11.117323 24717 leader_election.cc:302] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 164caba835a5490698ff878e951cdba7; no voters:
I20260812 06:26:11.117470 24717 leader_election.cc:288] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:26:11.117503 24720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:26:11.117641 24720 raft_consensus.cc:686] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [term 1 LEADER]: Becoming Leader. State: Replica: 164caba835a5490698ff878e951cdba7, State: Running, Role: LEADER
I20260812 06:26:11.117715 24717 sys_catalog.cc:564] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:26:11.117738 24720 consensus_queue.cc:237] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "164caba835a5490698ff878e951cdba7" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45845 } }
I20260812 06:26:11.118098 24722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 164caba835a5490698ff878e951cdba7. Latest consensus state: current_term: 1 leader_uuid: "164caba835a5490698ff878e951cdba7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "164caba835a5490698ff878e951cdba7" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45845 } } }
I20260812 06:26:11.118208 24721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "164caba835a5490698ff878e951cdba7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "164caba835a5490698ff878e951cdba7" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45845 } } }
I20260812 06:26:11.118245 24722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:11.118292 24721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:11.118664 24733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:26:11.119077 24733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:26:11.119866 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 24589
I20260812 06:26:11.119974 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:26:11.120151 30781 external_mini_cluster.cc:1428] Setting key 6204ea158061db063d392cd1299deb46
I20260812 06:26:11.120857 24733 catalog_manager.cc:1347] Generated new cluster ID: 427ce299d5124f8a81162b382d6d6c70
I20260812 06:26:11.120913 24733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:26:11 dist-test-slave-gjrz krb5kdc[24568](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:11.126224 24733 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:26:11.126798 24733 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:26:11.129884 24755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:11.120557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43378 (local address 127.30.15.126:45845)
0812 06:26:11.120697 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:11.120706 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:11.121017 (+ 311us) server_negotiation.cc:407] Connection header received
0812 06:26:11.121145 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:11.121151 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:11.121190 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:11.121295 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:11.121906 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:11.122838 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:11.123637 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:11.124053 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:11.124142 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:11.126288 (+ 2146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:11.126292 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:11.126292 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:11.126303 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:11.128165 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:11.128516 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:11.128518 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:11.128519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:11.128611 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:11.128771 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:11.128772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:11.128772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:11.129013 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:11.129148 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:11.129541 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 06:26:11.129673 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":68,"threads_started":1}
I20260812 06:26:11.130662 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:26:11.133215 24733 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 164caba835a5490698ff878e951cdba7: Generated new TSK 0
I20260812 06:26:11.133352 24733 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:26:11.184360 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 24589
2026-08-12T06:26:11Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1481 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:26:11 dist-test-slave-gjrz krb5kdc[24763](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:26:11 dist-test-slave-gjrz krb5kdc[24763](info): set up 2 sockets
Aug 12 06:26:11 dist-test-slave-gjrz krb5kdc[24763](info): commencing operation
krb5kdc: starting...
W20260812 06:26:12.374809 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:26:12 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:26:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:26:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:26:12.485743 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:44411
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:44411
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:12.563745 24793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:12.563927 24793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:12.563947 24793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:12.565038 24793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:26:12.565078 24793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:12.565090 24793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:12.565112 24793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:26:12.565135 24793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:26:12.566589 24793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:44411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:44411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:12.566810 24793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:12.567003 24793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:12.571609 24809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:12.571616 24806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:12.571635 24812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:12.571724 24793 server_base.cc:1034] running on GCE node
I20260812 06:26:12.572052 24793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:12.572304 24793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:12.573452 24793 hybrid_clock.cc:648] HybridClock initialized: now 1786515972573434 us; error 29 us; skew 500 ppm
Aug 12 06:26:12 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515972, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:12.582304 24793 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:26:12.582736 24793 webserver.cc:460] Webserver started at http://127.30.15.126:36305/ using document root <none> and password file <none>
I20260812 06:26:12.582932 24793 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:12.582980 24793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:12.583114 24793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:26:12.584157 24793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "a36648f51d79411893b03a1f158b574a"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "3a409df20f1e1684e38a57a3cd460eb4"
server_key_iv: "b8ba151bccdf65b99547b4590f839836"
server_key_version: "encryptionkey@0"
I20260812 06:26:12.584486 24793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "a36648f51d79411893b03a1f158b574a"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "3a409df20f1e1684e38a57a3cd460eb4"
server_key_iv: "b8ba151bccdf65b99547b4590f839836"
server_key_version: "encryptionkey@0"
I20260812 06:26:12.585690 24793 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:26:12.586349 24831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:12.586499 24793 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:26:12.586584 24793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "a36648f51d79411893b03a1f158b574a"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "3a409df20f1e1684e38a57a3cd460eb4"
server_key_iv: "b8ba151bccdf65b99547b4590f839836"
server_key_version: "encryptionkey@0"
I20260812 06:26:12.586651 24793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:12.613186 24793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:12.614836 24793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:12.614977 24793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:12.618888 24793 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:44411
I20260812 06:26:12.618943 24932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:44411 every 8 connection(s)
I20260812 06:26:12.619256 24793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:26:12.619728 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 24793
I20260812 06:26:12.619834 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:26:12.620031 30781 external_mini_cluster.cc:1428] Setting key 106ab7d825343caec9a07d89e76c249e
I20260812 06:26:12.620347 24935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:12.623651 24935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Bootstrap starting.
I20260812 06:26:12.624245 24935 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:12.624545 24935 log.cc:824] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:12.625250 24935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: No bootstrap required, opened a new log
Aug 12 06:26:12 dist-test-slave-gjrz krb5kdc[24763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:12.627228 24935 raft_consensus.cc:348] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } }
I20260812 06:26:12.627434 24935 raft_consensus.cc:374] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:12.627481 24935 raft_consensus.cc:729] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a36648f51d79411893b03a1f158b574a, State: Initialized, Role: FOLLOWER
I20260812 06:26:12.627601 24935 consensus_queue.cc:260] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } }
I20260812 06:26:12.627681 24935 raft_consensus.cc:388] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:26:12.627713 24935 raft_consensus.cc:482] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:26:12.627807 24935 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:12.628444 24935 raft_consensus.cc:504] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } }
I20260812 06:26:12.628553 24935 leader_election.cc:302] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a36648f51d79411893b03a1f158b574a; no voters:
I20260812 06:26:12.628715 24935 leader_election.cc:288] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:26:12.628760 24941 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:26:12.628930 24941 raft_consensus.cc:686] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 1 LEADER]: Becoming Leader. State: Replica: a36648f51d79411893b03a1f158b574a, State: Running, Role: LEADER
I20260812 06:26:12.628959 24935 sys_catalog.cc:564] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:26:12.629045 24941 consensus_queue.cc:237] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } }
I20260812 06:26:12.629369 24941 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a36648f51d79411893b03a1f158b574a. Latest consensus state: current_term: 1 leader_uuid: "a36648f51d79411893b03a1f158b574a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } } }
I20260812 06:26:12.629436 24941 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:12.630084 24943 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a36648f51d79411893b03a1f158b574a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } } }
I20260812 06:26:12.630204 24943 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:12.630348 24951 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:26:12.631012 24951 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:26:12.631014 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:12.620528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33542 (local address 127.30.15.126:44411)
0812 06:26:12.620713 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:12.620723 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:12.620755 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:26:12.621461 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:12.621471 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:12.621544 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:12.621696 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:12.622282 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:12.623617 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:12.624348 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:12.624888 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:12.624997 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:12.627297 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:12.627301 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:12.627302 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:12.627313 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:12.629206 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:12.629654 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:12.629658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:12.629658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:12.629766 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:12.629994 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:12.629995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:12.629996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:12.630313 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:12.630461 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:12.630699 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 06:26:12.630830 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":88,"threads_started":1}
I20260812 06:26:12.632434 24951 catalog_manager.cc:1347] Generated new cluster ID: d28d548470474ce5a29404239e95c16e
I20260812 06:26:12.632484 24951 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:26:12.655586 24951 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:26:12.656076 24951 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:26:12.665570 24951 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Generated new TSK 0
I20260812 06:26:12.665760 24951 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:26:12.690299 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44411
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:12.769887 24981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:12.770079 24981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:12.770109 24981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:12.771219 24981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:12.771288 24981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:12.771329 24981 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:26:12.772780 24981 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24981
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:12.773013 24981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:12.773213 24981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:12.777855 25000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:12.777918 24993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:12.777968 24991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:12.778112 24981 server_base.cc:1034] running on GCE node
I20260812 06:26:12.778276 24981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:12.778465 24981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:12.779588 24981 hybrid_clock.cc:648] HybridClock initialized: now 1786515972779576 us; error 28 us; skew 500 ppm
Aug 12 06:26:12 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515972, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:12.781919 24981 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:26:12.782295 24981 webserver.cc:460] Webserver started at http://127.30.15.65:45667/ using document root <none> and password file <none>
I20260812 06:26:12.782503 24981 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:12.782546 24981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:12.782660 24981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:26:12.783661 24981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "1e820bad18024930aa4229a0f1280a03"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "b4910bd53d3ddba413a6cd03695de561"
server_key_iv: "b95747f56ad376cfd33c6f6b0b069dc9"
server_key_version: "encryptionkey@0"
I20260812 06:26:12.783965 24981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "1e820bad18024930aa4229a0f1280a03"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "b4910bd53d3ddba413a6cd03695de561"
server_key_iv: "b95747f56ad376cfd33c6f6b0b069dc9"
server_key_version: "encryptionkey@0"
I20260812 06:26:12.785205 24981 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:26:12.785903 25009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:12.786074 24981 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:26:12.786155 24981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "1e820bad18024930aa4229a0f1280a03"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "b4910bd53d3ddba413a6cd03695de561"
server_key_iv: "b95747f56ad376cfd33c6f6b0b069dc9"
server_key_version: "encryptionkey@0"
I20260812 06:26:12.786211 24981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:12.810750 24981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:12.812390 24981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:12.812494 24981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:12.812662 24981 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:12.812906 24981 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:12.812935 24981 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:12.812955 24981 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:12.812969 24981 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:12.818542 24981 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:46269
I20260812 06:26:12.818611 25229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:46269 every 8 connection(s)
I20260812 06:26:12.818871 24981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:26:12 dist-test-slave-gjrz krb5kdc[24763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515972, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:12.824934 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 24981
I20260812 06:26:12.825037 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:26:12.825224 30781 external_mini_cluster.cc:1428] Setting key 9ebb21ff1717f18e398ce7294377cf4b
I20260812 06:26:12.827577 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:12.819531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:39527 (local address 127.30.15.126:44411)
0812 06:26:12.819586 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:12.819588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:12.819806 (+ 218us) server_negotiation.cc:407] Connection header received
0812 06:26:12.820257 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:12.820258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:12.820270 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:12.820322 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:12.821181 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:12.821689 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:12.822622 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:12.822826 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:12.822878 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:12.824784 (+ 1906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:12.824785 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:12.824785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:12.824791 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:12.826339 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:12.826713 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:12.826714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:12.826714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:12.826776 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:12.826970 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:12.826971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:12.826971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:12.827092 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:12.827152 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:12.827406 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 06:26:12.827492 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:26:12.827698 25236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:12.819485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:39527)
0812 06:26:12.819664 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:12.819705 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:12.820170 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:12.820379 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:12.820382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:12.820915 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:12.821100 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:12.821105 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:12.821753 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:12.821754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:12.822547 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:12.822550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:12.822888 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:12.822889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:12.822989 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:12.823422 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:12.823430 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:12.824704 (+ 1274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:12.826422 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:12.826429 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:12.826431 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:12.826644 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:12.826835 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:12.826835 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:12.826836 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:12.826923 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:12.827144 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:12.827147 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:12.827249 (+ 102us) client_negotiation.cc:769] Sending connection context
0812 06:26:12.827378 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 06:26:12.827498 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
I20260812 06:26:12.828172 25232 heartbeater.cc:347] Connected to a master server at 127.30.15.126:44411
I20260812 06:26:12.828266 25232 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:12.828442 25232 heartbeater.cc:511] Master 127.30.15.126:44411 requested a full tablet report, sending...
I20260812 06:26:12.828938 24865 ts_manager.cc:194] Registered new tserver with Master: 1e820bad18024930aa4229a0f1280a03 (127.30.15.65:46269)
I20260812 06:26:12.829804 24865 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:39527
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:26:12.848163 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44411
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:12.927603 25242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:12.927788 25242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:12.927817 25242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:12.929129 25242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:12.929183 25242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:12.929220 25242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:26:12.930871 25242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:12.931104 25242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:12.931329 25242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:12.935880 25253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:12.935853 25251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:12.935863 25250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:12.936097 25242 server_base.cc:1034] running on GCE node
I20260812 06:26:12.936283 25242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:12.936506 25242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:12.937664 25242 hybrid_clock.cc:648] HybridClock initialized: now 1786515972937653 us; error 28 us; skew 500 ppm
Aug 12 06:26:12 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515972, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:12.940016 25242 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:26:12.940438 25242 webserver.cc:460] Webserver started at http://127.30.15.66:46117/ using document root <none> and password file <none>
I20260812 06:26:12.940634 25242 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:12.940680 25242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:12.940797 25242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:26:12.941764 25242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "1438581d53d94251877e0ce52a660672"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "b32b812c8cedc6033c8e87aaf94a912f"
server_key_iv: "256c2a631aa4cd383f079273f330ff5a"
server_key_version: "encryptionkey@0"
I20260812 06:26:12.942108 25242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "1438581d53d94251877e0ce52a660672"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "b32b812c8cedc6033c8e87aaf94a912f"
server_key_iv: "256c2a631aa4cd383f079273f330ff5a"
server_key_version: "encryptionkey@0"
I20260812 06:26:12.943356 25242 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:26:12.944051 25265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:12.944202 25242 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:26:12.944283 25242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "1438581d53d94251877e0ce52a660672"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "b32b812c8cedc6033c8e87aaf94a912f"
server_key_iv: "256c2a631aa4cd383f079273f330ff5a"
server_key_version: "encryptionkey@0"
I20260812 06:26:12.944348 25242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:12.957708 25242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:12.959231 25242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:12.959373 25242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:12.959563 25242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:12.959820 25242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:12.959852 25242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:12.959877 25242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:12.959903 25242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:12.965370 25242 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:45959
I20260812 06:26:12.965444 25481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:45959 every 8 connection(s)
I20260812 06:26:12.965690 25242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:26:12 dist-test-slave-gjrz krb5kdc[24763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515972, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:12.972234 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 25242
I20260812 06:26:12.972546 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:26:12.972779 30781 external_mini_cluster.cc:1428] Setting key 9901ab06a6c7ec2916a4ad80d360bb05
I20260812 06:26:12.974377 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:12.966312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:38759 (local address 127.30.15.126:44411)
0812 06:26:12.966361 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:12.966363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:12.966568 (+ 205us) server_negotiation.cc:407] Connection header received
0812 06:26:12.967041 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:12.967042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:12.967052 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:12.967100 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:12.968006 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:12.968560 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:12.969504 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:12.969691 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:12.969740 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:12.971683 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:12.971684 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:12.971684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:12.971691 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:12.973106 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:12.973539 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:12.973540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:12.973540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:12.973606 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:12.973807 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:12.973808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:12.973808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:12.973930 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:12.974012 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:12.974213 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 06:26:12.974293 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:26:12.974434 25488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:12.966265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:38759)
0812 06:26:12.966435 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:12.966473 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:12.966936 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:12.967150 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:12.967153 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:12.967718 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:12.967893 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:12.967898 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:12.968641 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:12.968642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:12.969431 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:12.969433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:12.969765 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:12.969766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:12.969874 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:12.970312 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:12.970321 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:12.971602 (+ 1281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:12.973180 (+ 1578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:12.973187 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:12.973190 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:12.973460 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:12.973665 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:12.973665 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:12.973666 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:12.973757 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:12.973989 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:12.973993 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:12.974098 (+ 105us) client_negotiation.cc:769] Sending connection context
0812 06:26:12.974177 (+ 79us) client_negotiation.cc:240] Negotiation successful
0812 06:26:12.974287 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
I20260812 06:26:12.974881 25483 heartbeater.cc:347] Connected to a master server at 127.30.15.126:44411
I20260812 06:26:12.974977 25483 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:12.975154 25483 heartbeater.cc:511] Master 127.30.15.126:44411 requested a full tablet report, sending...
I20260812 06:26:12.975590 24865 ts_manager.cc:194] Registered new tserver with Master: 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959)
I20260812 06:26:12.976054 24865 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:38759
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:26:12.995333 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44411
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:13.074499 25496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:13.074677 25496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:13.074699 25496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:13.075757 25496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:13.075788 25496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:13.075812 25496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:26:13.077169 25496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25496
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:13.077340 25496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:13.077505 25496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:13.082182 25508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:13.082170 25505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:13.082204 25496 server_base.cc:1034] running on GCE node
W20260812 06:26:13.082161 25506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:13.082559 25496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:13.082769 25496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:13.083927 25496 hybrid_clock.cc:648] HybridClock initialized: now 1786515973083911 us; error 31 us; skew 500 ppm
Aug 12 06:26:13 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515973, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:13.086259 25496 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:26:13.086647 25496 webserver.cc:460] Webserver started at http://127.30.15.67:33281/ using document root <none> and password file <none>
I20260812 06:26:13.086836 25496 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:13.086877 25496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:13.086992 25496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:26:13.087983 25496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "b8d6b9ca7deb409d85a8d8f1367bd395"
format_stamp: "Formatted at 2026-08-12 06:26:13 on dist-test-slave-gjrz"
server_key: "d90b473ceb2e09e1e53444f0aa7d2bee"
server_key_iv: "b09c5e10918e64dfcd18bf558fb88b8a"
server_key_version: "encryptionkey@0"
I20260812 06:26:13.088295 25496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "b8d6b9ca7deb409d85a8d8f1367bd395"
format_stamp: "Formatted at 2026-08-12 06:26:13 on dist-test-slave-gjrz"
server_key: "d90b473ceb2e09e1e53444f0aa7d2bee"
server_key_iv: "b09c5e10918e64dfcd18bf558fb88b8a"
server_key_version: "encryptionkey@0"
I20260812 06:26:13.089771 25496 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:26:13.090487 25521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:13.090684 25496 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:26:13.090762 25496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "b8d6b9ca7deb409d85a8d8f1367bd395"
format_stamp: "Formatted at 2026-08-12 06:26:13 on dist-test-slave-gjrz"
server_key: "d90b473ceb2e09e1e53444f0aa7d2bee"
server_key_iv: "b09c5e10918e64dfcd18bf558fb88b8a"
server_key_version: "encryptionkey@0"
I20260812 06:26:13.090814 25496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:13.105906 25496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:13.107577 25496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:13.107682 25496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:13.107849 25496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:13.108093 25496 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:13.108129 25496 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:13.108148 25496 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:13.108165 25496 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:13.113685 25496 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:33627
I20260812 06:26:13.113746 25732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:33627 every 8 connection(s)
I20260812 06:26:13.113998 25496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:26:13.119671 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 25496
I20260812 06:26:13.119784 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
Aug 12 06:26:13 dist-test-slave-gjrz krb5kdc[24763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515973, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:13.119982 30781 external_mini_cluster.cc:1428] Setting key f3216d16c10423cbcf1e6eda805701c4
I20260812 06:26:13.122763 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.114620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:59449 (local address 127.30.15.126:44411)
0812 06:26:13.114680 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.114682 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.114853 (+ 171us) server_negotiation.cc:407] Connection header received
0812 06:26:13.115372 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.115373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.115385 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.115436 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:13.116347 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.116850 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.117793 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.117998 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.118053 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.120307 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:13.120309 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:13.120309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:13.120316 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:13.121625 (+ 1309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.121986 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.121987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.121987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.122033 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.122245 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.122246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.122247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.122366 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:13.122445 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.122633 (+ 188us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.122701 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:26:13.122906 25738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.114581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:59449)
0812 06:26:13.114744 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.114779 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:13.115276 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:13.115499 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:13.115503 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:13.116079 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:13.116255 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.116260 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.116932 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.116933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.117708 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.117711 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.118068 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.118069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.118190 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.118611 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:13.118619 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:13.120223 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:13.121697 (+ 1474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:13.121704 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:13.121705 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:13.121927 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:13.122078 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:13.122079 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:13.122079 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:13.122165 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:13.122427 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:13.122430 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:13.122541 (+ 111us) client_negotiation.cc:769] Sending connection context
0812 06:26:13.122613 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:26:13.122725 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":87,"threads_started":1}
I20260812 06:26:13.123369 25734 heartbeater.cc:347] Connected to a master server at 127.30.15.126:44411
I20260812 06:26:13.123456 25734 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:13.123623 25734 heartbeater.cc:511] Master 127.30.15.126:44411 requested a full tablet report, sending...
I20260812 06:26:13.123951 24865 ts_manager.cc:194] Registered new tserver with Master: b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627)
I20260812 06:26:13.124305 24865 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:59449
I20260812 06:26:13.131632 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:26:13.138278 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.132877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33550 (local address 127.30.15.126:44411)
0812 06:26:13.132930 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.132932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.133042 (+ 110us) server_negotiation.cc:407] Connection header received
0812 06:26:13.133105 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.133106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.133116 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.133162 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:13.133675 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.134137 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.134811 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.134995 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.135048 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.136088 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:13.136090 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:13.136090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:13.136096 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:13.137263 (+ 1167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.137574 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.137574 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.137575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.137626 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.137783 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.137784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.137784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.137919 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:13.138009 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.138118 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.138195 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260812 06:26:13.139703 24865 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33550:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:26:13.141254 24865 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:26:13.146584 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.143121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:45959 (local address 127.0.0.1:51436)
0812 06:26:13.143302 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.143340 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:13.143400 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:13.143689 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:13.143692 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:13.143694 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:13.143759 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.143760 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.144761 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.144762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.145543 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.145545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.146311 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.146312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.146393 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.146404 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 06:26:13.146461 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:26:13.146513 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":1,"thread_start_us":51,"threads_started":1}
I20260812 06:26:13.146878 25754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.143335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51436 (local address 127.30.15.66:45959)
0812 06:26:13.143525 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.143528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.143538 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:26:13.143577 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.143580 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.143595 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.143675 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:13.143846 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.144664 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.145624 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.146235 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.146295 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.146352 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.146763 (+ 411us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.146803 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":78,"threads_started":1}
I20260812 06:26:13.147449 25753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.143334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:33627 (local address 127.0.0.1:55000)
0812 06:26:13.143725 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.143734 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:13.143791 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:13.144021 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:13.144021 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:13.144023 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:13.144069 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.144071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.145270 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.145271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.146331 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.146334 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.147202 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.147204 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.147295 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.147300 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:26:13.147358 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:26:13.147399 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":49,"threads_started":1}
I20260812 06:26:13.147481 25756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.143495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55000 (local address 127.30.15.67:33627)
0812 06:26:13.143684 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.143688 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.143792 (+ 104us) server_negotiation.cc:407] Connection header received
0812 06:26:13.143856 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.143858 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.143872 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.143938 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:13.144143 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.145178 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.146423 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.147121 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.147191 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.147244 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.147373 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.147411 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":83,"threads_started":1}
I20260812 06:26:13.147569 25354 tablet_service.cc:1467] Processing CreateTablet for tablet 9bafb217fce846c8b9d6ff36dfc035b4 (DEFAULT_TABLE table=test-table [id=58b79439dfe34f27b5f4ea7468d07550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:13.147897 25354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bafb217fce846c8b9d6ff36dfc035b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:13.148094 25607 tablet_service.cc:1467] Processing CreateTablet for tablet 9bafb217fce846c8b9d6ff36dfc035b4 (DEFAULT_TABLE table=test-table [id=58b79439dfe34f27b5f4ea7468d07550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:13.148386 25607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bafb217fce846c8b9d6ff36dfc035b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:13.151338 25749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.143121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:46269 (local address 127.0.0.1:55496)
0812 06:26:13.143496 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.143504 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:13.143567 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:13.143818 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:13.143819 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:13.143821 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:13.143874 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.143876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.145184 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.145185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.146338 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.146340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.151077 (+ 4737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.151078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.151168 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.151172 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:26:13.151219 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 06:26:13.151257 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260812 06:26:13.151394 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.143233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55496 (local address 127.30.15.65:46269)
0812 06:26:13.143453 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.143457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.143566 (+ 109us) server_negotiation.cc:407] Connection header received
0812 06:26:13.143653 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.143656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.143670 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.143732 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:13.143964 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.145070 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.146460 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.147170 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.147239 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.147320 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.151249 (+ 3929us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.151314 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":106,"threads_started":1}
I20260812 06:26:13.151664 25759 tablet_bootstrap.cc:492] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672: Bootstrap starting.
I20260812 06:26:13.151726 25758 tablet_bootstrap.cc:492] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395: Bootstrap starting.
I20260812 06:26:13.152130 25101 tablet_service.cc:1467] Processing CreateTablet for tablet 9bafb217fce846c8b9d6ff36dfc035b4 (DEFAULT_TABLE table=test-table [id=58b79439dfe34f27b5f4ea7468d07550]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:13.152348 25758 tablet_bootstrap.cc:654] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:13.152348 25759 tablet_bootstrap.cc:654] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:13.152419 25101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bafb217fce846c8b9d6ff36dfc035b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:13.152920 25759 log.cc:824] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:13.152923 25758 log.cc:824] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:13.153596 25758 tablet_bootstrap.cc:492] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395: No bootstrap required, opened a new log
I20260812 06:26:13.153646 25758 ts_tablet_manager.cc:1397] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:26:13.153702 25759 tablet_bootstrap.cc:492] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672: No bootstrap required, opened a new log
I20260812 06:26:13.153762 25759 ts_tablet_manager.cc:1397] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:13.155085 25758 raft_consensus.cc:348] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } }
I20260812 06:26:13.155200 25758 raft_consensus.cc:374] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:13.155220 25758 raft_consensus.cc:729] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d6b9ca7deb409d85a8d8f1367bd395, State: Initialized, Role: FOLLOWER
I20260812 06:26:13.155332 25758 consensus_queue.cc:260] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } }
I20260812 06:26:13.155499 25768 tablet_bootstrap.cc:492] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Bootstrap starting.
I20260812 06:26:13.155606 25758 ts_tablet_manager.cc:1428] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:13.155625 25734 heartbeater.cc:503] Master 127.30.15.126:44411 was elected leader, sending a full tablet report...
I20260812 06:26:13.155761 25759 raft_consensus.cc:348] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } }
I20260812 06:26:13.155900 25759 raft_consensus.cc:374] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:13.155930 25759 raft_consensus.cc:729] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1438581d53d94251877e0ce52a660672, State: Initialized, Role: FOLLOWER
I20260812 06:26:13.156031 25759 consensus_queue.cc:260] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } }
I20260812 06:26:13.156092 25768 tablet_bootstrap.cc:654] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:13.156271 25759 ts_tablet_manager.cc:1428] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:26:13.156306 25483 heartbeater.cc:503] Master 127.30.15.126:44411 was elected leader, sending a full tablet report...
I20260812 06:26:13.156983 25768 log.cc:824] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:13.157622 25768 tablet_bootstrap.cc:492] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: No bootstrap required, opened a new log
I20260812 06:26:13.157673 25768 ts_tablet_manager.cc:1397] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:13.159121 25768 raft_consensus.cc:348] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } }
I20260812 06:26:13.159235 25768 raft_consensus.cc:374] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:13.159253 25768 raft_consensus.cc:729] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e820bad18024930aa4229a0f1280a03, State: Initialized, Role: FOLLOWER
I20260812 06:26:13.159373 25768 consensus_queue.cc:260] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } }
I20260812 06:26:13.159584 25768 ts_tablet_manager.cc:1428] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:13.159631 25232 heartbeater.cc:503] Master 127.30.15.126:44411 was elected leader, sending a full tablet report...
I20260812 06:26:13.170660 25777 raft_consensus.cc:482] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:26:13.170737 25777 raft_consensus.cc:504] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } }
I20260812 06:26:13.171015 25777 leader_election.cc:288] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959), b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627)
I20260812 06:26:13.173535 25756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.171203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:33465 (local address 127.30.15.67:33627)
0812 06:26:13.171247 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.171248 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.171256 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:26:13.171342 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.171343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.171351 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.171398 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:13.171531 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.171987 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.172849 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.173230 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.173292 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.173301 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.173446 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.173480 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:26:13.173534 25236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.171135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:33627 (local address 127.30.15.65:33465)
0812 06:26:13.171177 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.171189 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:13.171242 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:13.171408 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:13.171409 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:13.171410 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:13.171477 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.171478 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.172055 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.172056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.172768 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.172769 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.173300 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.173301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.173380 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.173383 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:26:13.173427 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:26:13.173466 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260812 06:26:13.173588 25754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.171205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:41457 (local address 127.30.15.66:45959)
0812 06:26:13.171244 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.171246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.171390 (+ 144us) server_negotiation.cc:407] Connection header received
0812 06:26:13.171445 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.171446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.171456 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.171500 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:13.171622 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.172052 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.172924 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.173288 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.173348 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.173355 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.173491 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.173522 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:26:13.173700 25778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.171135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:45959 (local address 127.30.15.65:41457)
0812 06:26:13.171324 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.171332 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:13.171389 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:13.171502 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:13.171502 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:13.171504 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:13.171567 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.171569 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.172120 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.172121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.172849 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.172851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.173358 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.173359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.173433 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.173436 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:26:13.173480 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:26:13.173518 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":44,"thread_start_us":101,"threads_started":1}
I20260812 06:26:13.173923 25652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bafb217fce846c8b9d6ff36dfc035b4" candidate_uuid: "1e820bad18024930aa4229a0f1280a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" is_pre_election: true
I20260812 06:26:13.173947 25401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bafb217fce846c8b9d6ff36dfc035b4" candidate_uuid: "1e820bad18024930aa4229a0f1280a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1438581d53d94251877e0ce52a660672" is_pre_election: true
I20260812 06:26:13.174053 25401 raft_consensus.cc:2454] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e820bad18024930aa4229a0f1280a03 in term 0.
I20260812 06:26:13.174052 25652 raft_consensus.cc:2454] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e820bad18024930aa4229a0f1280a03 in term 0.
I20260812 06:26:13.174270 25012 leader_election.cc:302] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e820bad18024930aa4229a0f1280a03, b8d6b9ca7deb409d85a8d8f1367bd395; no voters:
I20260812 06:26:13.174373 25777 raft_consensus.cc:2781] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:26:13.174427 25777 raft_consensus.cc:482] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:26:13.174454 25777 raft_consensus.cc:3037] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:13.175112 25777 raft_consensus.cc:504] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } }
I20260812 06:26:13.175220 25777 leader_election.cc:288] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 1 election: Requested vote from peers 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959), b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627)
I20260812 06:26:13.175401 25401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bafb217fce846c8b9d6ff36dfc035b4" candidate_uuid: "1e820bad18024930aa4229a0f1280a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1438581d53d94251877e0ce52a660672"
I20260812 06:26:13.175395 25652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bafb217fce846c8b9d6ff36dfc035b4" candidate_uuid: "1e820bad18024930aa4229a0f1280a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395"
I20260812 06:26:13.175467 25401 raft_consensus.cc:3037] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:13.175468 25652 raft_consensus.cc:3037] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:13.176103 25401 raft_consensus.cc:2454] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e820bad18024930aa4229a0f1280a03 in term 1.
I20260812 06:26:13.176106 25652 raft_consensus.cc:2454] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e820bad18024930aa4229a0f1280a03 in term 1.
I20260812 06:26:13.176247 25012 leader_election.cc:302] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e820bad18024930aa4229a0f1280a03, b8d6b9ca7deb409d85a8d8f1367bd395; no voters:
I20260812 06:26:13.176342 25777 raft_consensus.cc:2781] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:26:13.176465 25777 raft_consensus.cc:686] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 1 LEADER]: Becoming Leader. State: Replica: 1e820bad18024930aa4229a0f1280a03, State: Running, Role: LEADER
I20260812 06:26:13.176540 25777 consensus_queue.cc:237] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } }
I20260812 06:26:13.177218 24865 catalog_manager.cc:5495] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e820bad18024930aa4229a0f1280a03 (127.30.15.65). New cstate: current_term: 1 leader_uuid: "1e820bad18024930aa4229a0f1280a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } health_report { overall_health: UNKNOWN } } }
I20260812 06:26:13.181450 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.179510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55508 (local address 127.30.15.65:46269)
0812 06:26:13.179546 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.179548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.179557 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:26:13.179605 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.179605 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.179619 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.179678 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:26:13.179756 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.180191 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.180846 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.181027 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.181067 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.181166 (+ 99us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:26:13.181244 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:26:13.181297 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.181374 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.181390 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:26:13.182896 25652 raft_consensus.cc:1261] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 1 FOLLOWER]: Refusing update from remote peer 1e820bad18024930aa4229a0f1280a03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:26:13.182896 25401 raft_consensus.cc:1261] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672 [term 1 FOLLOWER]: Refusing update from remote peer 1e820bad18024930aa4229a0f1280a03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:26:13.183166 25777 consensus_queue.cc:1035] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:26:13.183308 25779 consensus_queue.cc:1035] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:26:13.185853 25784 mvcc.cc:205] Tried to move back new op lower bound from 7317569426155106304 to 7317569426131628032. Current Snapshot: MvccSnapshot[applied={T|T < 7317569426155106304}]
I20260812 06:26:13.186669 25785 mvcc.cc:205] Tried to move back new op lower bound from 7317569426155106304 to 7317569426131628032. Current Snapshot: MvccSnapshot[applied={T|T < 7317569426155106304 or (T in {7317569426155106304})}]
I20260812 06:26:13.187525 24865 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33550:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:26:13.187597 24865 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33550:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:26:13.188211 24865 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Sending DeleteTablet for 3 replicas of tablet 9bafb217fce846c8b9d6ff36dfc035b4
I20260812 06:26:13.188508 25101 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bafb217fce846c8b9d6ff36dfc035b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:13 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:55496
I20260812 06:26:13.188557 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 24981
I20260812 06:26:13.188560 25354 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bafb217fce846c8b9d6ff36dfc035b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:13 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:51436
I20260812 06:26:13.198697 25804 tablet_replica.cc:330] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672: stopping tablet replica
I20260812 06:26:13.198809 25804 raft_consensus.cc:2229] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:26:13.198915 25804 raft_consensus.cc:2258] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:13.201581 25804 ts_tablet_manager.cc:1905] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:26:13.202859 25804 ts_tablet_manager.cc:1918] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:26:13.202919 25804 log.cc:1196] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/9bafb217fce846c8b9d6ff36dfc035b4
I20260812 06:26:13.203111 25804 ts_tablet_manager.cc:1939] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1438581d53d94251877e0ce52a660672: Deleting consensus metadata
I20260812 06:26:13.203482 24833 catalog_manager.cc:4841] TS 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959): tablet 9bafb217fce846c8b9d6ff36dfc035b4 (table test-table [id=58b79439dfe34f27b5f4ea7468d07550]) successfully deleted
I20260812 06:26:13.206180 25607 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bafb217fce846c8b9d6ff36dfc035b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:13 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:55000
I20260812 06:26:13.206398 25806 tablet_replica.cc:330] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395: stopping tablet replica
W20260812 06:26:13.206442 24837 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:46269 (error 108)
I20260812 06:26:13.206503 25806 raft_consensus.cc:2229] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:26:13.206612 25806 raft_consensus.cc:2258] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:13.206735 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 25242
I20260812 06:26:13.212905 25749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.206821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:46269 (local address 127.0.0.1:55524)
0812 06:26:13.212817 (+ 5996us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.212870 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:46269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5968}
W20260812 06:26:13.215067 24837 catalog_manager.cc:4584] TS 1e820bad18024930aa4229a0f1280a03 (127.30.15.65:46269): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9bafb217fce846c8b9d6ff36dfc035b4: Network error: Client connection negotiation failed: client connection to 127.30.15.65:46269: connect: Connection refused (error 111)
I20260812 06:26:13.217233 25806 ts_tablet_manager.cc:1905] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:26:13.218426 25806 ts_tablet_manager.cc:1918] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:26:13.218484 25806 log.cc:1196] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/9bafb217fce846c8b9d6ff36dfc035b4
I20260812 06:26:13.218689 25806 ts_tablet_manager.cc:1939] T 9bafb217fce846c8b9d6ff36dfc035b4 P b8d6b9ca7deb409d85a8d8f1367bd395: Deleting consensus metadata
I20260812 06:26:13.219136 24834 catalog_manager.cc:4841] TS b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627): tablet 9bafb217fce846c8b9d6ff36dfc035b4 (table test-table [id=58b79439dfe34f27b5f4ea7468d07550]) successfully deleted
I20260812 06:26:13.228803 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 25496
I20260812 06:26:13.242231 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 24793
I20260812 06:26:13.253401 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:44411
--webserver_interface=127.30.15.126
--webserver_port=36305
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:44411
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:13.333974 25808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:13.334168 25808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:13.334188 25808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:13.335327 25808 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:26:13.335366 25808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:13.335378 25808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:13.335389 25808 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:26:13.335403 25808 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:26:13.336800 25808 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:44411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:44411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=36305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:13.336984 25808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:13.337163 25808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:13.345714 25820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:13.345820 25824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:13.345729 25819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:13.345903 25808 server_base.cc:1034] running on GCE node
I20260812 06:26:13.346158 25808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:13.346451 25808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:13.347596 25808 hybrid_clock.cc:648] HybridClock initialized: now 1786515973347571 us; error 41 us; skew 500 ppm
Aug 12 06:26:13 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515973, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:13.349978 25808 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:26:13.350421 25808 webserver.cc:460] Webserver started at http://127.30.15.126:36305/ using document root <none> and password file <none>
I20260812 06:26:13.350623 25808 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:13.350685 25808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:13.352007 25808 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:26:13.352581 25843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:13.352725 25808 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:26:13.352806 25808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "a36648f51d79411893b03a1f158b574a"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "3a409df20f1e1684e38a57a3cd460eb4"
server_key_iv: "b8ba151bccdf65b99547b4590f839836"
server_key_version: "encryptionkey@0"
I20260812 06:26:13.353175 25808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:13.361615 25808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:13.363593 25808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:13.363716 25808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:13.367640 25808 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:44411
I20260812 06:26:13.367668 25947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:44411 every 8 connection(s)
I20260812 06:26:13.368017 25808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:26:13.369511 25948 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:26:13.370103 25948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Bootstrap starting.
I20260812 06:26:13.378172 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 25808
I20260812 06:26:13.378455 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:46269
--local_ip_for_outbound_sockets=127.30.15.65
--tserver_master_addrs=127.30.15.126:44411
--webserver_port=45667
--webserver_interface=127.30.15.65
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:26:13.378896 25948 log.cc:824] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:13.381024 25948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:26:13.381345 25948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Bootstrap complete.
I20260812 06:26:13.383608 25948 raft_consensus.cc:348] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } }
I20260812 06:26:13.383827 25948 raft_consensus.cc:729] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a36648f51d79411893b03a1f158b574a, State: Initialized, Role: FOLLOWER
I20260812 06:26:13.383967 25948 consensus_queue.cc:260] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } }
I20260812 06:26:13.384027 25948 raft_consensus.cc:388] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:26:13.384079 25948 raft_consensus.cc:482] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:26:13.384124 25948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:26:13.385085 25948 raft_consensus.cc:504] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } }
I20260812 06:26:13.385172 25948 leader_election.cc:302] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a36648f51d79411893b03a1f158b574a; no voters:
I20260812 06:26:13.385319 25948 leader_election.cc:288] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:26:13.385368 25959 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:26:13.385484 25959 raft_consensus.cc:686] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 2 LEADER]: Becoming Leader. State: Replica: a36648f51d79411893b03a1f158b574a, State: Running, Role: LEADER
I20260812 06:26:13.385576 25948 sys_catalog.cc:564] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:26:13.385582 25959 consensus_queue.cc:237] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } }
I20260812 06:26:13.385975 25960 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a36648f51d79411893b03a1f158b574a. Latest consensus state: current_term: 2 leader_uuid: "a36648f51d79411893b03a1f158b574a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } } }
I20260812 06:26:13.386130 25960 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:13.386343 25961 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a36648f51d79411893b03a1f158b574a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } } }
I20260812 06:26:13.386430 25979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:26:13.386459 25961 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:13.387193 25979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:26:13.387333 25979 catalog_manager.cc:1259] Loaded cluster ID: d28d548470474ce5a29404239e95c16e
I20260812 06:26:13.387373 25979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:26:13.387844 25979 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 06:26:13.392452 25979 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 06:26:13.394780 25979 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:26:13.395226 25979 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Loaded TSK: 0
I20260812 06:26:13.395484 25979 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:26:13.460386 25956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:13.460577 25956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:13.460608 25956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:13.461697 25956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:13.461736 25956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:13.461774 25956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:26:13.463197 25956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:46269
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=45667
--tserver_master_addrs=127.30.15.126:44411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:13.463438 25956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:13.463675 25956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:13.468425 26001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:13.468449 26006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:13.468631 25956 server_base.cc:1034] running on GCE node
W20260812 06:26:13.468752 26004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:13.468958 25956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:13.469260 25956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:13.470430 25956 hybrid_clock.cc:648] HybridClock initialized: now 1786515973470419 us; error 27 us; skew 500 ppm
Aug 12 06:26:13 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515973, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:13.473312 25956 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:26:13.473858 25956 webserver.cc:460] Webserver started at http://127.30.15.65:45667/ using document root <none> and password file <none>
I20260812 06:26:13.474128 25956 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:13.474202 25956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:13.475826 25956 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:26:13.476533 26023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:13.476689 25956 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:26:13.476761 25956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "1e820bad18024930aa4229a0f1280a03"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "b4910bd53d3ddba413a6cd03695de561"
server_key_iv: "b95747f56ad376cfd33c6f6b0b069dc9"
server_key_version: "encryptionkey@0"
I20260812 06:26:13.477061 25956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:13.486073 25956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:13.488039 25956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:13.488149 25956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:13.488355 25956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:13.488750 26040 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 06:26:13.490523 25956 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:26:13.490566 25956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 06:26:13.490595 25956 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 06:26:13.491429 25956 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 06:26:13.491484 25956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:13.491740 26040 tablet_bootstrap.cc:492] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Bootstrap starting.
I20260812 06:26:13.497928 25956 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:46269
I20260812 06:26:13.498296 25956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:26:13.499519 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 25956
I20260812 06:26:13.499830 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:45959
--local_ip_for_outbound_sockets=127.30.15.66
--tserver_master_addrs=127.30.15.126:44411
--webserver_port=46117
--webserver_interface=127.30.15.66
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:26:13.505134 26040 log.cc:824] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:13.508714 26255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:46269 every 8 connection(s)
I20260812 06:26:13.511582 26040 tablet_bootstrap.cc:492] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:26:13.511861 26040 tablet_bootstrap.cc:492] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Bootstrap complete.
I20260812 06:26:13.513090 26040 ts_tablet_manager.cc:1397] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.010s
I20260812 06:26:13.514998 26040 raft_consensus.cc:348] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } }
I20260812 06:26:13.515357 26040 raft_consensus.cc:729] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e820bad18024930aa4229a0f1280a03, State: Initialized, Role: FOLLOWER
I20260812 06:26:13.515520 26040 consensus_queue.cc:260] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } }
I20260812 06:26:13.515787 26040 ts_tablet_manager.cc:1428] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
Aug 12 06:26:13 dist-test-slave-gjrz krb5kdc[24763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515973, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:13.525401 26264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.509793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:50853)
0812 06:26:13.513546 (+ 3753us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.513596 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:13.514542 (+ 946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:13.515101 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:13.515105 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:13.515653 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:13.515950 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.515956 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.517529 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.517530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.518735 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.518738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.519563 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.519564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.519703 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.520266 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:13.520275 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:13.521949 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:13.523997 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:13.524004 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:13.524006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:13.524219 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:13.524483 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:13.524483 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:13.524484 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:13.524573 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:13.524958 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:13.524961 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:13.525068 (+ 107us) client_negotiation.cc:769] Sending connection context
0812 06:26:13.525142 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:26:13.525255 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3700,"thread_start_us":98,"threads_started":1}
I20260812 06:26:13.525520 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.509847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:50853 (local address 127.30.15.126:44411)
0812 06:26:13.513845 (+ 3998us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.513854 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.513896 (+ 42us) server_negotiation.cc:407] Connection header received
0812 06:26:13.514797 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.514803 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.514855 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.514965 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:13.516078 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.517430 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.518822 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.519457 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.519555 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.522054 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:13.522058 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:13.522058 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:13.522070 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:13.523910 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.524296 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.524299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.524299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.524418 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.524624 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.524625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.524625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.524900 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:13.524984 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.525207 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.525338 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3947,"thread_start_us":80,"threads_started":1}
I20260812 06:26:13.526103 26256 heartbeater.cc:347] Connected to a master server at 127.30.15.126:44411
I20260812 06:26:13.526198 26256 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:13.526367 26256 heartbeater.cc:511] Master 127.30.15.126:44411 requested a full tablet report, sending...
I20260812 06:26:13.527073 25879 ts_manager.cc:194] Registered new tserver with Master: 1e820bad18024930aa4229a0f1280a03 (127.30.15.65:46269)
I20260812 06:26:13.528003 25879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:50853
I20260812 06:26:13.528891 26256 heartbeater.cc:503] Master 127.30.15.126:44411 was elected leader, sending a full tablet report...
Aug 12 06:26:13 dist-test-slave-gjrz krb5kdc[24763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515973, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.65@KRBTEST.COM
I20260812 06:26:13.535549 26277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.527983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55534 (local address 127.30.15.65:46269)
0812 06:26:13.528158 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.528162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.528171 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:26:13.528201 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.528203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.528215 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.528282 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:13.528744 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.529644 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.530616 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.530890 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.530935 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.533011 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:13.533018 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:13.533018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:13.533024 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:13.534385 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.534733 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.534736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.534736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.534787 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.534954 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.534955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.534955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.535088 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:13.535158 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.535366 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.535448 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":83,"threads_started":1}
I20260812 06:26:13.535537 26275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.527619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:46269 (local address 127.0.0.1:55534)
0812 06:26:13.527782 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.527816 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:13.527876 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:13.528316 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:13.528323 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:13.528616 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:13.528665 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.528668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.529715 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.529716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.530547 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.530550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.530949 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.530950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.531027 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.531488 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:13.531493 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:13.532934 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:13.534463 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:13.534470 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:13.534471 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:13.534661 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:13.534844 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:13.534845 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:13.534845 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:13.534904 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:13.535151 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:13.535158 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:13.535210 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 06:26:13.535320 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 06:26:13.535440 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260812 06:26:13.536093 26118 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bafb217fce846c8b9d6ff36dfc035b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:13 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:55534
I20260812 06:26:13.536590 26278 tablet_replica.cc:330] stopping tablet replica
I20260812 06:26:13.536674 26278 raft_consensus.cc:2229] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:26:13.536736 26278 raft_consensus.cc:2258] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:13.536993 26278 ts_tablet_manager.cc:1905] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:26:13.538847 26278 ts_tablet_manager.cc:1918] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:26:13.538910 26278 log.cc:1196] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal/wals/9bafb217fce846c8b9d6ff36dfc035b4
I20260812 06:26:13.539129 26278 ts_tablet_manager.cc:1939] T 9bafb217fce846c8b9d6ff36dfc035b4 P 1e820bad18024930aa4229a0f1280a03: Deleting consensus metadata
I20260812 06:26:13.539584 25852 catalog_manager.cc:4841] TS 1e820bad18024930aa4229a0f1280a03 (127.30.15.65:46269): tablet 9bafb217fce846c8b9d6ff36dfc035b4 (table test-table [id=58b79439dfe34f27b5f4ea7468d07550]) successfully deleted
W20260812 06:26:13.593787 26258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:13.593976 26258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:13.594007 26258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:13.595093 26258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:13.595134 26258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:13.595166 26258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:26:13.596593 26258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:45959
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=46117
--tserver_master_addrs=127.30.15.126:44411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:13.596822 26258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:13.597023 26258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:13.601604 26286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:13.601644 26288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:13.601751 26258 server_base.cc:1034] running on GCE node
W20260812 06:26:13.601612 26292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:13.602051 26258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:13.602265 26258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:13.603386 26258 hybrid_clock.cc:648] HybridClock initialized: now 1786515973603378 us; error 25 us; skew 500 ppm
Aug 12 06:26:13 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515973, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:13.605626 26258 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:26:13.606007 26258 webserver.cc:460] Webserver started at http://127.30.15.66:46117/ using document root <none> and password file <none>
I20260812 06:26:13.606209 26258 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:13.606268 26258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:13.607470 26258 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:13.607987 26303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:13.608125 26258 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:13.608204 26258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "1438581d53d94251877e0ce52a660672"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "b32b812c8cedc6033c8e87aaf94a912f"
server_key_iv: "256c2a631aa4cd383f079273f330ff5a"
server_key_version: "encryptionkey@0"
I20260812 06:26:13.608492 26258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:13.624253 26258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:13.625844 26258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:13.625977 26258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:13.626163 26258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:13.626430 26258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:13.626461 26258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:13.626487 26258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:13.626513 26258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:13.632165 26258 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:45959
I20260812 06:26:13.632222 26511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:45959 every 8 connection(s)
I20260812 06:26:13.632516 26258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:26:13 dist-test-slave-gjrz krb5kdc[24763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515973, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:13.640393 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.633162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:45969 (local address 127.30.15.126:44411)
0812 06:26:13.633247 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.633250 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.633396 (+ 146us) server_negotiation.cc:407] Connection header received
0812 06:26:13.633856 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.633857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.633867 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.633902 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:13.634747 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.635233 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.636175 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.636364 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.636406 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.638242 (+ 1836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:13.638244 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:13.638244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:13.638252 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:13.639355 (+ 1103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.639737 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.639737 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.639737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.639784 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.639941 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.639941 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.639941 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.640033 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:13.640076 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.640269 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.640329 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 06:26:13.640545 26518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.633145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:45969)
0812 06:26:13.633289 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.633323 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:13.633768 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:13.633957 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:13.633961 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:13.634496 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:13.634679 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.634684 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.635329 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.635330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.636112 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.636115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.636415 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.636416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.636505 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.636857 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:13.636865 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:13.638151 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:13.639448 (+ 1297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:13.639456 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:13.639458 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:13.639679 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:13.639822 (+ 143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:13.639822 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:13.639823 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:13.639903 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:13.640076 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:13.640079 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:13.640182 (+ 103us) client_negotiation.cc:769] Sending connection context
0812 06:26:13.640253 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:26:13.640362 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":80,"threads_started":1}
I20260812 06:26:13.641002 26512 heartbeater.cc:347] Connected to a master server at 127.30.15.126:44411
I20260812 06:26:13.641089 26512 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:13.641250 26512 heartbeater.cc:511] Master 127.30.15.126:44411 requested a full tablet report, sending...
I20260812 06:26:13.641563 25879 ts_manager.cc:194] Registered new tserver with Master: 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959)
I20260812 06:26:13.641909 25879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:45969
I20260812 06:26:13.642475 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 26258
I20260812 06:26:13.642724 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:33627
--local_ip_for_outbound_sockets=127.30.15.67
--tserver_master_addrs=127.30.15.126:44411
--webserver_port=33281
--webserver_interface=127.30.15.67
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:13.724130 26519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:13.724313 26519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:13.724334 26519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:13.725441 26519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:13.725482 26519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:13.725507 26519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:26:13.726923 26519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:33627
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=33281
--tserver_master_addrs=127.30.15.126:44411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:13.727142 26519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:13.727381 26519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:13.731999 26525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:13.732100 26527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:13.732159 26519 server_base.cc:1034] running on GCE node
W20260812 06:26:13.732009 26529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:13.732453 26519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:13.732681 26519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:13.733814 26519 hybrid_clock.cc:648] HybridClock initialized: now 1786515973733803 us; error 26 us; skew 500 ppm
Aug 12 06:26:13 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515973, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:13.736106 26519 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:26:13.736533 26519 webserver.cc:460] Webserver started at http://127.30.15.67:33281/ using document root <none> and password file <none>
I20260812 06:26:13.736748 26519 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:13.736819 26519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:13.738106 26519 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:13.738682 26543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:13.738834 26519 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:26:13.738916 26519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "b8d6b9ca7deb409d85a8d8f1367bd395"
format_stamp: "Formatted at 2026-08-12 06:26:13 on dist-test-slave-gjrz"
server_key: "d90b473ceb2e09e1e53444f0aa7d2bee"
server_key_iv: "b09c5e10918e64dfcd18bf558fb88b8a"
server_key_version: "encryptionkey@0"
I20260812 06:26:13.739223 26519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:13.769528 26519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:13.771376 26519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:13.771521 26519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:13.771761 26519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:13.772068 26519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:13.772101 26519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:13.772131 26519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:13.772148 26519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:13.777916 26519 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:33627
I20260812 06:26:13.777977 26744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:33627 every 8 connection(s)
I20260812 06:26:13.778298 26519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:26:13 dist-test-slave-gjrz krb5kdc[24763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515973, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:13.786580 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.778970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:54237 (local address 127.30.15.126:44411)
0812 06:26:13.779021 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.779023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.779222 (+ 199us) server_negotiation.cc:407] Connection header received
0812 06:26:13.779811 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.779813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.779822 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.779868 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:13.780811 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.781301 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.782241 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.782417 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.782459 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.784344 (+ 1885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:13.784345 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:13.784345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:13.784352 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:13.785443 (+ 1091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.785783 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.785784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.785784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.785829 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.786001 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.786002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.786002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.786095 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:13.786169 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.786448 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.786509 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:26:13.786796 26750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.778928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:54237)
0812 06:26:13.779093 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.779141 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:13.779697 (+ 556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:13.779935 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:13.779938 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:13.780546 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:13.780739 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.780745 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.781364 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.781364 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.782181 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.782183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.782468 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.782468 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.782570 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.782945 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:13.782953 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:13.784258 (+ 1305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:13.785512 (+ 1254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:13.785519 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:13.785521 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:13.785727 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:13.785872 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:13.785872 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:13.785873 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:13.785961 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:13.786190 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:13.786196 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:13.786316 (+ 120us) client_negotiation.cc:769] Sending connection context
0812 06:26:13.786400 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 06:26:13.786585 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260812 06:26:13.787204 26747 heartbeater.cc:347] Connected to a master server at 127.30.15.126:44411
I20260812 06:26:13.787312 26747 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:13.787490 26747 heartbeater.cc:511] Master 127.30.15.126:44411 requested a full tablet report, sending...
I20260812 06:26:13.787837 25879 ts_manager.cc:194] Registered new tserver with Master: b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627)
I20260812 06:26:13.788213 25879 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:54237
I20260812 06:26:13.788209 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 26519
I20260812 06:26:13.793736 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.788554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33564 (local address 127.30.15.126:44411)
0812 06:26:13.788589 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.788591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.788713 (+ 122us) server_negotiation.cc:407] Connection header received
0812 06:26:13.788777 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.788777 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.788786 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.788829 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:13.789338 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.789790 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.790500 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.790688 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.790739 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.791813 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:13.791814 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:13.791814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:13.791821 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:13.792774 (+ 953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.793070 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.793071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.793071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.793122 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:13.793287 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:13.793287 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:13.793288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:13.793396 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:13.793557 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.793593 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.793658 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:26:13.794358 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:26:13.796589 26269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.794654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33568 (local address 127.30.15.126:44411)
0812 06:26:13.794704 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.794706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.794752 (+ 46us) server_negotiation.cc:407] Connection header received
0812 06:26:13.794805 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.794806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.794833 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.794884 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:26:13.794952 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.795427 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.796091 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.796251 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.796289 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.796388 (+ 99us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:26:13.796467 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:26:13.796518 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.796528 (+ 10us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.796541 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:26:13.796850 25879 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:33568:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:26:13.798388 25879 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:26:13.800293 26118 tablet_service.cc:1467] Processing CreateTablet for tablet 5cf0208bc9ee47e6b8eb428a22f58d43 (DEFAULT_TABLE table=test-table [id=d792ab6502084b099db4ac1783084ef1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:13.800496 26118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cf0208bc9ee47e6b8eb428a22f58d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:13.802049 26040 tablet_bootstrap.cc:492] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03: Bootstrap starting.
I20260812 06:26:13.802467 26040 tablet_bootstrap.cc:654] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:13.803017 26040 tablet_bootstrap.cc:492] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03: No bootstrap required, opened a new log
I20260812 06:26:13.803068 26040 ts_tablet_manager.cc:1397] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:13.803439 26040 raft_consensus.cc:348] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:13.803519 26040 raft_consensus.cc:374] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:13.803577 26040 raft_consensus.cc:729] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e820bad18024930aa4229a0f1280a03, State: Initialized, Role: FOLLOWER
I20260812 06:26:13.803622 26040 consensus_queue.cc:260] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:13.803718 26040 ts_tablet_manager.cc:1428] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260812 06:26:13.804054 26275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.800032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:33627 (local address 127.0.0.1:55006)
0812 06:26:13.800082 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.800091 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:13.800125 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:13.800528 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:13.800530 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:13.800531 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:13.800574 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.800576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.801737 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.801738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.802860 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.802863 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.803777 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.803778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.803851 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.803874 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 06:26:13.803939 (+ 65us) client_negotiation.cc:240] Negotiation successful
0812 06:26:13.803988 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":5}
I20260812 06:26:13.804065 26759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.800204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55006 (local address 127.30.15.67:33627)
0812 06:26:13.800349 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.800353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.800363 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:26:13.800394 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.800396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.800410 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.800518 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:13.800641 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.801644 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.802936 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.803702 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.803775 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.803838 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.803954 (+ 116us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.803996 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
I20260812 06:26:13.804399 26758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.800033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:45959 (local address 127.0.0.1:51446)
0812 06:26:13.800139 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:13.800149 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:13.800198 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:13.800676 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:13.800677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:13.800679 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:13.800711 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.800713 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.801647 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.801648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.802860 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:13.802863 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.804171 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.804172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:13.804239 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.804243 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:26:13.804295 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 06:26:13.804334 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":39,"thread_start_us":54,"threads_started":1}
I20260812 06:26:13.804430 26763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:13.800254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51446 (local address 127.30.15.66:45959)
0812 06:26:13.800443 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:13.800447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:13.800457 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:26:13.800496 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:13.800498 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:13.800512 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:13.800689 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:13.800772 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.801552 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.803327 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:13.804064 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:13.804162 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:13.804227 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:13.804310 (+ 83us) server_negotiation.cc:299] Negotiation successful
0812 06:26:13.804353 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":73,"threads_started":1}
I20260812 06:26:13.804768 26623 tablet_service.cc:1467] Processing CreateTablet for tablet 5cf0208bc9ee47e6b8eb428a22f58d43 (DEFAULT_TABLE table=test-table [id=d792ab6502084b099db4ac1783084ef1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:13.805116 26623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cf0208bc9ee47e6b8eb428a22f58d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:13.805064 26393 tablet_service.cc:1467] Processing CreateTablet for tablet 5cf0208bc9ee47e6b8eb428a22f58d43 (DEFAULT_TABLE table=test-table [id=d792ab6502084b099db4ac1783084ef1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:13.805372 26393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cf0208bc9ee47e6b8eb428a22f58d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:13.808709 26767 tablet_bootstrap.cc:492] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395: Bootstrap starting.
I20260812 06:26:13.808905 26771 tablet_bootstrap.cc:492] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672: Bootstrap starting.
I20260812 06:26:13.809494 26767 tablet_bootstrap.cc:654] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:13.809507 26771 tablet_bootstrap.cc:654] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:13.810103 26771 log.cc:824] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:13.810105 26767 log.cc:824] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:13.810837 26771 tablet_bootstrap.cc:492] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672: No bootstrap required, opened a new log
I20260812 06:26:13.810855 26767 tablet_bootstrap.cc:492] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395: No bootstrap required, opened a new log
I20260812 06:26:13.810902 26771 ts_tablet_manager.cc:1397] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:13.810911 26767 ts_tablet_manager.cc:1397] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:13.812332 26767 raft_consensus.cc:348] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:13.812357 26771 raft_consensus.cc:348] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:13.812454 26767 raft_consensus.cc:374] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:13.812475 26767 raft_consensus.cc:729] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d6b9ca7deb409d85a8d8f1367bd395, State: Initialized, Role: FOLLOWER
I20260812 06:26:13.812479 26771 raft_consensus.cc:374] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:13.812525 26771 raft_consensus.cc:729] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1438581d53d94251877e0ce52a660672, State: Initialized, Role: FOLLOWER
I20260812 06:26:13.812577 26767 consensus_queue.cc:260] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:13.812635 26771 consensus_queue.cc:260] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:13.812844 26767 ts_tablet_manager.cc:1428] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:13.812848 26747 heartbeater.cc:503] Master 127.30.15.126:44411 was elected leader, sending a full tablet report...
I20260812 06:26:13.812919 26771 ts_tablet_manager.cc:1428] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:13.813002 26512 heartbeater.cc:503] Master 127.30.15.126:44411 was elected leader, sending a full tablet report...
W20260812 06:26:13.883121 26516 tablet.cc:2369] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:26:14.010576 26257 tablet.cc:2369] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:26:14.028836 26749 tablet.cc:2369] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:26:14.045513 26274 raft_consensus.cc:482] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:26:14.045634 26274 raft_consensus.cc:504] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:14.045966 26274 leader_election.cc:288] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627), 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959)
I20260812 06:26:14.048782 26759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.046188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:35115 (local address 127.30.15.67:33627)
0812 06:26:14.046236 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:14.046238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:14.046333 (+ 95us) server_negotiation.cc:407] Connection header received
0812 06:26:14.046425 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:14.046426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:14.046435 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:14.046491 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:14.046644 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:14.047137 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:14.048088 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:14.048454 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:14.048514 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:14.048524 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:14.048682 (+ 158us) server_negotiation.cc:299] Negotiation successful
0812 06:26:14.048721 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:26:14.048821 26763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.046207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:54455 (local address 127.30.15.66:45959)
0812 06:26:14.046256 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:14.046258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:14.046393 (+ 135us) server_negotiation.cc:407] Connection header received
0812 06:26:14.046472 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:14.046473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:14.046482 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:14.046534 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:14.046666 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:14.047154 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:14.048110 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:14.048506 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:14.048571 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:14.048579 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:14.048718 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 06:26:14.048755 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:26:14.048834 26780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.046119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:33627 (local address 127.30.15.65:35115)
0812 06:26:14.046269 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:14.046279 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:14.046355 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:14.046502 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:14.046503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:14.046505 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:14.046589 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:14.046591 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:14.047204 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:14.047205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:14.048002 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:14.048005 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:14.048523 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:14.048524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:14.048604 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:14.048622 (+ 18us) client_negotiation.cc:769] Sending connection context
0812 06:26:14.048668 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 06:26:14.048709 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":1,"thread_start_us":58,"threads_started":1}
I20260812 06:26:14.049013 26786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.046119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:45959 (local address 127.30.15.65:54455)
0812 06:26:14.046310 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:14.046320 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:14.046403 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:14.046541 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:14.046543 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:14.046544 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:14.046607 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:14.046608 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:14.047232 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:14.047233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:14.048014 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:14.048017 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:14.048584 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:14.048585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:14.048656 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:14.048659 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:26:14.048703 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:26:14.048742 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":69,"thread_start_us":78,"threads_started":1}
I20260812 06:26:14.049108 26665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cf0208bc9ee47e6b8eb428a22f58d43" candidate_uuid: "1e820bad18024930aa4229a0f1280a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" is_pre_election: true
I20260812 06:26:14.049281 26665 raft_consensus.cc:2454] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e820bad18024930aa4229a0f1280a03 in term 0.
I20260812 06:26:14.049363 26426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cf0208bc9ee47e6b8eb428a22f58d43" candidate_uuid: "1e820bad18024930aa4229a0f1280a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1438581d53d94251877e0ce52a660672" is_pre_election: true
I20260812 06:26:14.049506 26027 leader_election.cc:302] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e820bad18024930aa4229a0f1280a03, b8d6b9ca7deb409d85a8d8f1367bd395; no voters:
I20260812 06:26:14.049539 26426 raft_consensus.cc:2454] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e820bad18024930aa4229a0f1280a03 in term 0.
I20260812 06:26:14.049638 26274 raft_consensus.cc:2781] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:26:14.049691 26274 raft_consensus.cc:482] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:26:14.049713 26274 raft_consensus.cc:3037] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:14.050402 26274 raft_consensus.cc:504] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:14.050526 26274 leader_election.cc:288] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 1 election: Requested vote from peers b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627), 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959)
I20260812 06:26:14.050664 26665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cf0208bc9ee47e6b8eb428a22f58d43" candidate_uuid: "1e820bad18024930aa4229a0f1280a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395"
I20260812 06:26:14.050748 26665 raft_consensus.cc:3037] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:14.051498 26665 raft_consensus.cc:2454] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e820bad18024930aa4229a0f1280a03 in term 1.
I20260812 06:26:14.051604 26426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5cf0208bc9ee47e6b8eb428a22f58d43" candidate_uuid: "1e820bad18024930aa4229a0f1280a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1438581d53d94251877e0ce52a660672"
I20260812 06:26:14.051648 26027 leader_election.cc:302] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e820bad18024930aa4229a0f1280a03, b8d6b9ca7deb409d85a8d8f1367bd395; no voters:
I20260812 06:26:14.051682 26426 raft_consensus.cc:3037] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:14.051759 26274 raft_consensus.cc:2781] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:26:14.051889 26274 raft_consensus.cc:686] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 LEADER]: Becoming Leader. State: Replica: 1e820bad18024930aa4229a0f1280a03, State: Running, Role: LEADER
I20260812 06:26:14.051956 26274 consensus_queue.cc:237] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:14.052551 26426 raft_consensus.cc:2454] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e820bad18024930aa4229a0f1280a03 in term 1.
I20260812 06:26:14.052670 25876 catalog_manager.cc:5495] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e820bad18024930aa4229a0f1280a03 (127.30.15.65). New cstate: current_term: 1 leader_uuid: "1e820bad18024930aa4229a0f1280a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } health_report { overall_health: HEALTHY } } }
I20260812 06:26:14.084609 26789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.082255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55538 (local address 127.30.15.65:46269)
0812 06:26:14.082406 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:14.082407 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:14.082413 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:26:14.082444 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:14.082445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:14.082460 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:14.082527 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:26:14.082654 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:14.083134 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:14.083857 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:14.084073 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:14.084128 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:14.084290 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:26:14.084386 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:26:14.084447 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:14.084491 (+ 44us) server_negotiation.cc:299] Negotiation successful
0812 06:26:14.084512 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260812 06:26:14.086113 26665 raft_consensus.cc:1261] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 1 FOLLOWER]: Refusing update from remote peer 1e820bad18024930aa4229a0f1280a03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:26:14.086112 26426 raft_consensus.cc:1261] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672 [term 1 FOLLOWER]: Refusing update from remote peer 1e820bad18024930aa4229a0f1280a03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:26:14.086431 26787 consensus_queue.cc:1035] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:26:14.086565 26274 consensus_queue.cc:1035] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:26:14.089115 26793 mvcc.cc:205] Tried to move back new op lower bound from 7317569429854347264 to 7317569429717438464. Current Snapshot: MvccSnapshot[applied={T|T < 7317569429854347264}]
I20260812 06:26:14.089808 26794 mvcc.cc:205] Tried to move back new op lower bound from 7317569429854347264 to 7317569429717438464. Current Snapshot: MvccSnapshot[applied={T|T < 7317569429854347264 or (T in {7317569429854347264})}]
I20260812 06:26:14.090996 25876 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:33568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:26:14.091089 25876 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:33568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:26:14.091822 25876 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Sending DeleteTablet for 3 replicas of tablet 5cf0208bc9ee47e6b8eb428a22f58d43
I20260812 06:26:14.092123 26623 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cf0208bc9ee47e6b8eb428a22f58d43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:14 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:55006
I20260812 06:26:14.092203 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 25956
I20260812 06:26:14.092353 26393 tablet_service.cc:1514] Processing DeleteTablet for tablet 5cf0208bc9ee47e6b8eb428a22f58d43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:14 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:51446
I20260812 06:26:14.099450 26813 tablet_replica.cc:330] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395: stopping tablet replica
I20260812 06:26:14.099576 26813 raft_consensus.cc:2229] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:26:14.099678 26813 raft_consensus.cc:2258] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:14.101104 26813 ts_tablet_manager.cc:1905] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:26:14.102612 26813 ts_tablet_manager.cc:1918] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:26:14.102769 26813 log.cc:1196] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/5cf0208bc9ee47e6b8eb428a22f58d43
I20260812 06:26:14.103226 26813 ts_tablet_manager.cc:1939] T 5cf0208bc9ee47e6b8eb428a22f58d43 P b8d6b9ca7deb409d85a8d8f1367bd395: Deleting consensus metadata
I20260812 06:26:14.103677 25849 catalog_manager.cc:4841] TS b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627): tablet 5cf0208bc9ee47e6b8eb428a22f58d43 (table test-table [id=d792ab6502084b099db4ac1783084ef1]) successfully deleted
I20260812 06:26:14.107999 26814 tablet_replica.cc:330] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672: stopping tablet replica
I20260812 06:26:14.108109 26814 raft_consensus.cc:2229] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:26:14.108217 26814 raft_consensus.cc:2258] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:14.108594 26814 ts_tablet_manager.cc:1905] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:26:14.109983 26814 ts_tablet_manager.cc:1918] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:26:14.110044 26814 log.cc:1196] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/5cf0208bc9ee47e6b8eb428a22f58d43
I20260812 06:26:14.110241 26814 ts_tablet_manager.cc:1939] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1438581d53d94251877e0ce52a660672: Deleting consensus metadata
I20260812 06:26:14.110596 25848 catalog_manager.cc:4841] TS 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959): tablet 5cf0208bc9ee47e6b8eb428a22f58d43 (table test-table [id=d792ab6502084b099db4ac1783084ef1]) successfully deleted
W20260812 06:26:14.112411 25852 connection.cc:535] client connection to 127.30.15.65:46269 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:26:14.112555 25852 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:26:14.112978 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 26258
I20260812 06:26:14.112990 26758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.112873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:46269 (local address 127.0.0.1:55540)
0812 06:26:14.112929 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:14.112964 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:46269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260812 06:26:14.114847 25852 catalog_manager.cc:4584] TS 1e820bad18024930aa4229a0f1280a03 (127.30.15.65:46269): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5cf0208bc9ee47e6b8eb428a22f58d43: Network error: Client connection negotiation failed: client connection to 127.30.15.65:46269: connect: Connection refused (error 111)
I20260812 06:26:14.126029 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 26519
I20260812 06:26:14.141300 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 25808
I20260812 06:26:14.155107 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:44411
--webserver_interface=127.30.15.126
--webserver_port=36305
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:44411
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:14.236511 26820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:14.236693 26820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:14.236714 26820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:14.237807 26820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:26:14.237846 26820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:14.237859 26820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:14.237870 26820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:26:14.237881 26820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:26:14.239347 26820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:44411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:44411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=36305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:14.239576 26820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:14.239769 26820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:14.244637 26839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:14.244750 26820 server_base.cc:1034] running on GCE node
W20260812 06:26:14.244699 26836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:14.244648 26842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:14.245122 26820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:14.245384 26820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:14.246533 26820 hybrid_clock.cc:648] HybridClock initialized: now 1786515974246516 us; error 31 us; skew 500 ppm
Aug 12 06:26:14 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515974, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:14.248895 26820 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:26:14.249315 26820 webserver.cc:460] Webserver started at http://127.30.15.126:36305/ using document root <none> and password file <none>
I20260812 06:26:14.249507 26820 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:14.249557 26820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:14.250748 26820 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:14.251317 26853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:14.251463 26820 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:14.251550 26820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "a36648f51d79411893b03a1f158b574a"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "3a409df20f1e1684e38a57a3cd460eb4"
server_key_iv: "b8ba151bccdf65b99547b4590f839836"
server_key_version: "encryptionkey@0"
I20260812 06:26:14.251837 26820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:14.269441 26820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:14.271164 26820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:14.271322 26820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:14.274974 26820 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:44411
I20260812 06:26:14.275019 26964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:44411 every 8 connection(s)
I20260812 06:26:14.275368 26820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:26:14.276834 26965 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:26:14.277442 26965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Bootstrap starting.
I20260812 06:26:14.279930 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 26820
I20260812 06:26:14.280200 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:46269
--local_ip_for_outbound_sockets=127.30.15.65
--tserver_master_addrs=127.30.15.126:44411
--webserver_port=45667
--webserver_interface=127.30.15.65
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:26:14.286386 26965 log.cc:824] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:14.288625 26965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:26:14.288893 26965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a: Bootstrap complete.
I20260812 06:26:14.290966 26965 raft_consensus.cc:348] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } }
I20260812 06:26:14.291181 26965 raft_consensus.cc:729] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a36648f51d79411893b03a1f158b574a, State: Initialized, Role: FOLLOWER
I20260812 06:26:14.291333 26965 consensus_queue.cc:260] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } }
I20260812 06:26:14.291401 26965 raft_consensus.cc:388] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:26:14.291440 26965 raft_consensus.cc:482] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:26:14.291489 26965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:26:14.292490 26965 raft_consensus.cc:504] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } }
I20260812 06:26:14.292579 26965 leader_election.cc:302] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a36648f51d79411893b03a1f158b574a; no voters:
I20260812 06:26:14.292737 26965 leader_election.cc:288] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 06:26:14.292793 26970 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:26:14.292910 26970 raft_consensus.cc:686] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [term 3 LEADER]: Becoming Leader. State: Replica: a36648f51d79411893b03a1f158b574a, State: Running, Role: LEADER
I20260812 06:26:14.293000 26965 sys_catalog.cc:564] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:26:14.293021 26970 consensus_queue.cc:237] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } }
I20260812 06:26:14.293291 26970 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a36648f51d79411893b03a1f158b574a. Latest consensus state: current_term: 3 leader_uuid: "a36648f51d79411893b03a1f158b574a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } } }
I20260812 06:26:14.293361 26970 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:14.293336 26972 sys_catalog.cc:455] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "a36648f51d79411893b03a1f158b574a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a36648f51d79411893b03a1f158b574a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44411 } } }
I20260812 06:26:14.293686 26982 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:26:14.293713 26972 sys_catalog.cc:458] T 00000000000000000000000000000000 P a36648f51d79411893b03a1f158b574a [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:14.294763 26982 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:26:14.294869 26982 catalog_manager.cc:1259] Loaded cluster ID: d28d548470474ce5a29404239e95c16e
I20260812 06:26:14.294903 26982 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 06:26:14.295117 26982 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f4ca7d7f9ad google::LogMessage::Fail() at ??:0
@ 0x7f4ca7d8288a google::LogMessage::SendToLog() at ??:0
@ 0x7f4ca7d7f4de google::LogMessage::Flush() at ??:0
@ 0x7f4ca7d80a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4cafca00f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f4cafca98b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f4ca9c4d0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4ca9c42954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4caaaa66db start_thread at ??:0
@ 0x7f4ca687d61f clone at ??:0
W20260812 06:26:14.373020 26967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:14.373194 26967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:14.373215 26967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:14.374337 26967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:14.374377 26967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:14.374401 26967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:26:14.375823 26967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:46269
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=45667
--tserver_master_addrs=127.30.15.126:44411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:14.376026 26967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:14.376226 26967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:14.381960 27032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:14.381982 27029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:14.382076 26967 server_base.cc:1034] running on GCE node
W20260812 06:26:14.382174 27036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:14.382390 26967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:14.382604 26967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:14.383773 26967 hybrid_clock.cc:648] HybridClock initialized: now 1786515974383760 us; error 27 us; skew 500 ppm
Aug 12 06:26:14 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515974, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:14.386247 26967 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:26:14.386657 26967 webserver.cc:460] Webserver started at http://127.30.15.65:45667/ using document root <none> and password file <none>
I20260812 06:26:14.386842 26967 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:14.386888 26967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:14.388139 26967 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:14.388742 27055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:14.388933 26967 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:26:14.389035 26967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "1e820bad18024930aa4229a0f1280a03"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "b4910bd53d3ddba413a6cd03695de561"
server_key_iv: "b95747f56ad376cfd33c6f6b0b069dc9"
server_key_version: "encryptionkey@0"
I20260812 06:26:14.389453 26967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:14.401947 26967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:14.404219 26967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:14.404367 26967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:14.404639 26967 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:14.405117 27066 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 06:26:14.406500 26967 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:26:14.406561 26967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 06:26:14.406594 26967 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 06:26:14.407507 26967 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 06:26:14.407555 26967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260812 06:26:14.407612 27066 tablet_bootstrap.cc:492] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03: Bootstrap starting.
I20260812 06:26:14.414844 26967 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:46269
I20260812 06:26:14.415006 27268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:46269 every 8 connection(s)
I20260812 06:26:14.415299 26967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:26:14.415725 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 26967
I20260812 06:26:14.415997 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:45959
--local_ip_for_outbound_sockets=127.30.15.66
--tserver_master_addrs=127.30.15.126:44411
--webserver_port=46117
--webserver_interface=127.30.15.66
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:26:14.418804 27066 log.cc:824] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:14.423974 27066 tablet_bootstrap.cc:492] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:26:14.424280 27066 tablet_bootstrap.cc:492] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03: Bootstrap complete.
I20260812 06:26:14.425534 27066 ts_tablet_manager.cc:1397] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.011s
I20260812 06:26:14.426970 27066 raft_consensus.cc:348] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:14.427377 27066 raft_consensus.cc:729] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e820bad18024930aa4229a0f1280a03, State: Initialized, Role: FOLLOWER
I20260812 06:26:14.427556 27066 consensus_queue.cc:260] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:14.427850 27066 ts_tablet_manager.cc:1428] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
W20260812 06:26:14.475564 27273 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:26:14.416036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:39231)
0812 06:26:14.416682 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:14.416734 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:14.417354 (+ 620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:14.475352 (+ 57998us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":137,"threads_started":1}
W20260812 06:26:14.475839 27269 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:44411 (0 consecutive failures): Network error: Failed to ping master at 127.30.15.126:44411: Client connection negotiation failed: client connection to 127.30.15.126:44411: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:26:14.476182 27273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.476071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:47493)
0812 06:26:14.476120 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:14.476159 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:26:14.476482 27273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.476396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:58085)
0812 06:26:14.476435 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:14.476460 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 06:26:14.476601 27269 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:26:14.500926 27274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:14.501106 27274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:14.501127 27274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:14.502247 27274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:14.502287 27274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:14.502315 27274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:26:14.503786 27274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:45959
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=46117
--tserver_master_addrs=127.30.15.126:44411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:14.503994 27274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:14.504195 27274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:14.508831 27290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:14.508957 27274 server_base.cc:1034] running on GCE node
W20260812 06:26:14.508848 27288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:14.508839 27294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:14.509238 27274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:14.509461 27274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:14.510601 27274 hybrid_clock.cc:648] HybridClock initialized: now 1786515974510588 us; error 27 us; skew 500 ppm
Aug 12 06:26:14 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515974, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:14.512882 27274 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:26:14.513255 27274 webserver.cc:460] Webserver started at http://127.30.15.66:46117/ using document root <none> and password file <none>
I20260812 06:26:14.513480 27274 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:14.513525 27274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:14.514695 27274 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:14.515188 27305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:14.515334 27274 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:14.515422 27274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "1438581d53d94251877e0ce52a660672"
format_stamp: "Formatted at 2026-08-12 06:26:12 on dist-test-slave-gjrz"
server_key: "b32b812c8cedc6033c8e87aaf94a912f"
server_key_iv: "256c2a631aa4cd383f079273f330ff5a"
server_key_version: "encryptionkey@0"
I20260812 06:26:14.515707 27274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:14.534888 27274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:14.537333 27274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:14.537490 27274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:14.542040 27274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:14.542354 27274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:14.542409 27274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:14.542436 27274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:14.542459 27274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:14.548467 27274 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:45959
I20260812 06:26:14.548516 27520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:45959 every 8 connection(s)
I20260812 06:26:14.548816 27274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:26:14.549770 27530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.549416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:42771)
0812 06:26:14.549568 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:14.549639 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":78,"threads_started":1}
W20260812 06:26:14.550141 27521 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:44411 (0 consecutive failures): Network error: Failed to ping master at 127.30.15.126:44411: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
I20260812 06:26:14.550392 27530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.550303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:38003)
0812 06:26:14.550342 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:14.550367 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260812 06:26:14.550629 27530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.550557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:42425)
0812 06:26:14.550590 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:14.550610 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260812 06:26:14.550716 27521 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:26:14.552569 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 27274
I20260812 06:26:14.552793 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:33627
--local_ip_for_outbound_sockets=127.30.15.67
--tserver_master_addrs=127.30.15.126:44411
--webserver_port=33281
--webserver_interface=127.30.15.67
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:14.633437 27531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:14.633633 27531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:14.633664 27531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:14.634773 27531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:14.634814 27531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:14.634848 27531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:26:14.636279 27531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:33627
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=33281
--tserver_master_addrs=127.30.15.126:44411
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:14.636518 27531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:14.636719 27531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:14.641757 27538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:14.641768 27546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:14.641770 27540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:14.642196 27531 server_base.cc:1034] running on GCE node
I20260812 06:26:14.642395 27531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:14.642607 27531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:14.643750 27531 hybrid_clock.cc:648] HybridClock initialized: now 1786515974643737 us; error 29 us; skew 500 ppm
Aug 12 06:26:14 dist-test-slave-gjrz krb5kdc[24763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515974, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:14.646098 27531 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:26:14.646520 27531 webserver.cc:460] Webserver started at http://127.30.15.67:33281/ using document root <none> and password file <none>
I20260812 06:26:14.646689 27531 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:14.646726 27531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:14.648003 27531 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:26:14.648530 27567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:14.648676 27531 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:14.648761 27531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "b8d6b9ca7deb409d85a8d8f1367bd395"
format_stamp: "Formatted at 2026-08-12 06:26:13 on dist-test-slave-gjrz"
server_key: "d90b473ceb2e09e1e53444f0aa7d2bee"
server_key_iv: "b09c5e10918e64dfcd18bf558fb88b8a"
server_key_version: "encryptionkey@0"
I20260812 06:26:14.649115 27531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:14.662436 27531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:14.664438 27531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:14.664573 27531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:14.664780 27531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:14.665074 27531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:14.665107 27531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:14.665134 27531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:14.665150 27531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:14.671000 27531 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:33627
I20260812 06:26:14.671043 27796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:33627 every 8 connection(s)
I20260812 06:26:14.671378 27531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:26:14.672379 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.672029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:51887)
0812 06:26:14.672173 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:14.672244 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
W20260812 06:26:14.672713 27797 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:44411 (0 consecutive failures): Network error: Failed to ping master at 127.30.15.126:44411: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
I20260812 06:26:14.672984 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.672880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:43361)
0812 06:26:14.672917 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:14.672967 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260812 06:26:14.673187 27799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:14.673138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:51217)
0812 06:26:14.673158 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:14.673175 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260812 06:26:14.673264 27797 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:26:14.678081 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 27531
I20260812 06:26:15.477156 27803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:15.476907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:39885)
0812 06:26:15.477045 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:15.477093 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":61,"threads_started":1}
I20260812 06:26:15.551214 27804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:15.551025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:41155)
0812 06:26:15.551133 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:15.551163 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":59,"threads_started":1}
I20260812 06:26:15.673722 27808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:15.673539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:43999)
0812 06:26:15.673639 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:15.673672 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":52,"threads_started":1}
I20260812 06:26:16.005249 27809 raft_consensus.cc:482] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:26:16.005370 27809 raft_consensus.cc:504] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:16.005715 27809 leader_election.cc:288] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627), 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959)
Aug 12 06:26:16 dist-test-slave-gjrz krb5kdc[24763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515974, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.66@KRBTEST.COM
Aug 12 06:26:16 dist-test-slave-gjrz krb5kdc[24763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515974, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.67@KRBTEST.COM
I20260812 06:26:16.015405 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:16.005984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:51841 (local address 127.30.15.67:33627)
0812 06:26:16.006139 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:16.006149 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:16.006182 (+ 33us) server_negotiation.cc:407] Connection header received
0812 06:26:16.006639 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:16.006641 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:16.006692 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:16.006806 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:16.007624 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:16.008500 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:16.009526 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:16.009943 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:16.010042 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:16.012439 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:16.012442 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:16.012442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:16.012452 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:16.013879 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:16.014262 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:16.014265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:16.014266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:16.014353 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:16.014584 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:16.014585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:16.014586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:16.014811 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:16.014881 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:16.015153 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 06:26:16.015298 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":56,"threads_started":1}
I20260812 06:26:16.015393 27811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:16.005850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:33627 (local address 127.30.15.65:51841)
0812 06:26:16.005972 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:16.005982 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:16.006040 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:16.006907 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:16.006908 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:16.007296 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:16.007503 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:16.007506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:16.008587 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:16.008588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:16.009447 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:16.009450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:16.010024 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:16.010025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:16.010131 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:16.010675 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:16.010679 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:16.012340 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:16.013956 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:16.013957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:16.013958 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:16.014193 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:16.014412 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:16.014413 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:16.014413 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:16.014528 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:16.014874 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:16.014880 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:16.015003 (+ 123us) client_negotiation.cc:769] Sending connection context
0812 06:26:16.015091 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 06:26:16.015290 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":47,"thread_start_us":72,"threads_started":1}
I20260812 06:26:16.015533 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:16.005850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:45959 (local address 127.30.15.65:52721)
0812 06:26:16.005974 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:16.005982 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:16.006040 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:16.006885 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:16.006888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:16.007292 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:16.007486 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:16.007492 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:16.008579 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:16.008580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:16.009446 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:16.009448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:16.010027 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:16.010028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:16.010133 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:16.010635 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:16.010643 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:16.012016 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:16.013908 (+ 1892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:16.013916 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:16.013918 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:16.014193 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:16.014417 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:16.014417 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:16.014418 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:16.014526 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:16.014885 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:16.014886 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:16.015004 (+ 118us) client_negotiation.cc:769] Sending connection context
0812 06:26:16.015092 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 06:26:16.015438 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":257,"thread_start_us":63,"threads_started":1}
I20260812 06:26:16.015717 27816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:16.005987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:52721 (local address 127.30.15.66:45959)
0812 06:26:16.006173 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:16.006182 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:16.006210 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:26:16.006651 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:16.006653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:16.006692 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:16.006814 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:16.007610 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:16.008481 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:16.009530 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:16.009943 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:16.010042 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:16.012121 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:16.012125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:16.012125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:16.012137 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:16.013831 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:16.014265 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:16.014268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:16.014269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:16.014358 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:16.014586 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:16.014587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:16.014587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:16.014820 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:16.014890 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:16.015410 (+ 520us) server_negotiation.cc:299] Negotiation successful
0812 06:26:16.015538 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":58,"threads_started":1}
W20260812 06:26:16.016448 27059 leader_election.cc:341] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959): Not found: Tablet not found: 5cf0208bc9ee47e6b8eb428a22f58d43
W20260812 06:26:16.016664 27061 leader_election.cc:341] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627): Not found: Tablet not found: 5cf0208bc9ee47e6b8eb428a22f58d43
I20260812 06:26:16.016713 27061 leader_election.cc:302] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e820bad18024930aa4229a0f1280a03; no voters: 1438581d53d94251877e0ce52a660672, b8d6b9ca7deb409d85a8d8f1367bd395
I20260812 06:26:16.016830 27809 raft_consensus.cc:2726] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:26:16.477718 27811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:16.477577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:38465)
0812 06:26:16.477650 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:16.477678 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 06:26:16.551798 27819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:16.551610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:55055)
0812 06:26:16.551728 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:16.551761 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":63,"threads_started":1}
I20260812 06:26:16.674300 27820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:16.674122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:50301)
0812 06:26:16.674229 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:16.674262 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":59,"threads_started":1}
I20260812 06:26:17.478317 27821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:17.478096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:57023)
0812 06:26:17.478236 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:17.478268 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260812 06:26:17.552403 27826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:17.552174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:56921)
0812 06:26:17.552314 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:17.552353 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":62,"threads_started":1}
I20260812 06:26:17.663808 27829 raft_consensus.cc:482] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:26:17.663905 27829 raft_consensus.cc:504] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:17.664074 27829 leader_election.cc:288] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627), 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959)
W20260812 06:26:17.664450 27059 leader_election.cc:341] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959): Not found: Tablet not found: 5cf0208bc9ee47e6b8eb428a22f58d43
W20260812 06:26:17.664561 27061 leader_election.cc:341] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627): Not found: Tablet not found: 5cf0208bc9ee47e6b8eb428a22f58d43
I20260812 06:26:17.664628 27061 leader_election.cc:302] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e820bad18024930aa4229a0f1280a03; no voters: 1438581d53d94251877e0ce52a660672, b8d6b9ca7deb409d85a8d8f1367bd395
I20260812 06:26:17.664708 27829 raft_consensus.cc:2726] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:26:17.674917 27832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:17.674717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:51021)
0812 06:26:17.674848 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:17.674879 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":62,"threads_started":1}
I20260812 06:26:18.478969 27835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:18.478744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:57213)
0812 06:26:18.478885 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:18.478922 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":62,"threads_started":1}
I20260812 06:26:18.552947 27837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:18.552774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:56209)
0812 06:26:18.552875 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:18.552908 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":57,"threads_started":1}
I20260812 06:26:18.675580 27838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:18.675346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:39081)
0812 06:26:18.675502 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:18.675538 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":80,"threads_started":1}
I20260812 06:26:19.479676 27839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:19.479479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:39719)
0812 06:26:19.479594 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:19.479630 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":62,"threads_started":1}
I20260812 06:26:19.553496 27840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:19.553320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:40535)
0812 06:26:19.553427 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:19.553455 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":60,"threads_started":1}
I20260812 06:26:19.602325 27842 raft_consensus.cc:482] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:26:19.602421 27842 raft_consensus.cc:504] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:19.602571 27842 leader_election.cc:288] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627), 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959)
W20260812 06:26:19.602911 27059 leader_election.cc:341] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959): Not found: Tablet not found: 5cf0208bc9ee47e6b8eb428a22f58d43
W20260812 06:26:19.602993 27061 leader_election.cc:341] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627): Not found: Tablet not found: 5cf0208bc9ee47e6b8eb428a22f58d43
I20260812 06:26:19.603060 27061 leader_election.cc:302] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e820bad18024930aa4229a0f1280a03; no voters: 1438581d53d94251877e0ce52a660672, b8d6b9ca7deb409d85a8d8f1367bd395
I20260812 06:26:19.603128 27842 raft_consensus.cc:2726] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:26:19.676160 27844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:19.675962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:55489)
0812 06:26:19.676082 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:19.676120 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
I20260812 06:26:20.480302 27845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:20.480097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:53837)
0812 06:26:20.480215 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:20.480253 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":63,"threads_started":1}
I20260812 06:26:20.554082 27846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:20.553890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:36427)
0812 06:26:20.554012 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:20.554041 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":58,"threads_started":1}
I20260812 06:26:20.676759 27847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:20.676529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:41481)
0812 06:26:20.676652 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:20.676716 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260812 06:26:21.466257 27851 raft_consensus.cc:482] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:26:21.466352 27851 raft_consensus.cc:504] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:21.466496 27851 leader_election.cc:288] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627), 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959)
W20260812 06:26:21.466907 27061 leader_election.cc:341] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627): Not found: Tablet not found: 5cf0208bc9ee47e6b8eb428a22f58d43
W20260812 06:26:21.467013 27059 leader_election.cc:341] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959): Not found: Tablet not found: 5cf0208bc9ee47e6b8eb428a22f58d43
I20260812 06:26:21.467087 27059 leader_election.cc:302] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e820bad18024930aa4229a0f1280a03; no voters: 1438581d53d94251877e0ce52a660672, b8d6b9ca7deb409d85a8d8f1367bd395
I20260812 06:26:21.467175 27851 raft_consensus.cc:2726] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:26:21.480862 27855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:21.480688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:34651)
0812 06:26:21.480793 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:21.480822 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":58,"threads_started":1}
I20260812 06:26:21.554648 27857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:21.554435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:41541)
0812 06:26:21.554553 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:21.554590 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
I20260812 06:26:21.677441 27861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:21.677199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:53025)
0812 06:26:21.677333 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:21.677371 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
I20260812 06:26:22.481464 27862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:22.481258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:36427)
0812 06:26:22.481378 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:22.481415 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":65,"threads_started":1}
I20260812 06:26:22.555280 27866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:22.555076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:38043)
0812 06:26:22.555183 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:22.555218 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":61,"threads_started":1}
I20260812 06:26:22.678082 27867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:22.677879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:57433)
0812 06:26:22.677997 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:22.678039 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":61,"threads_started":1}
I20260812 06:26:23.482152 27869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:23.481928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:53383)
0812 06:26:23.482071 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:23.482103 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
I20260812 06:26:23.555855 27870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:23.555626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:49087)
0812 06:26:23.555775 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:23.555813 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":73,"threads_started":1}
I20260812 06:26:23.678673 27871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:23.678452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:32787)
0812 06:26:23.678594 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:23.678630 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":71,"threads_started":1}
I20260812 06:26:24.482762 27872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:24.482572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:53369)
0812 06:26:24.482685 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:24.482716 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
I20260812 06:26:24.556470 27873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:24.556213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:57511)
0812 06:26:24.556375 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:24.556418 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":89,"threads_started":1}
I20260812 06:26:24.679351 27876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:24.679059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:55031)
0812 06:26:24.679246 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:24.679308 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":136,"threads_started":1}
I20260812 06:26:25.483367 27877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:25.483100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:33435)
0812 06:26:25.483245 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:25.483312 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":64,"threads_started":1}
I20260812 06:26:25.557099 27880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:25.556886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:40649)
0812 06:26:25.557010 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:25.557058 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260812 06:26:25.676192 27881 raft_consensus.cc:482] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:26:25.676282 27881 raft_consensus.cc:504] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d6b9ca7deb409d85a8d8f1367bd395" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 33627 } } peers { permanent_uuid: "1438581d53d94251877e0ce52a660672" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 45959 } } peers { permanent_uuid: "1e820bad18024930aa4229a0f1280a03" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 46269 } }
I20260812 06:26:25.676430 27881 leader_election.cc:288] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627), 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959)
W20260812 06:26:25.676817 27059 leader_election.cc:341] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1438581d53d94251877e0ce52a660672 (127.30.15.66:45959): Not found: Tablet not found: 5cf0208bc9ee47e6b8eb428a22f58d43
W20260812 06:26:25.676921 27061 leader_election.cc:341] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b8d6b9ca7deb409d85a8d8f1367bd395 (127.30.15.67:33627): Not found: Tablet not found: 5cf0208bc9ee47e6b8eb428a22f58d43
I20260812 06:26:25.676985 27061 leader_election.cc:302] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e820bad18024930aa4229a0f1280a03; no voters: 1438581d53d94251877e0ce52a660672, b8d6b9ca7deb409d85a8d8f1367bd395
I20260812 06:26:25.677064 27881 raft_consensus.cc:2726] T 5cf0208bc9ee47e6b8eb428a22f58d43 P 1e820bad18024930aa4229a0f1280a03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:26:25.679888 27885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:25.679704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:37951)
0812 06:26:25.679816 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:25.679849 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":69,"threads_started":1}
I20260812 06:26:26.483973 27886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:26.483759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:38655)
0812 06:26:26.483887 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:26.483923 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260812 06:26:26.557684 27890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:26.557485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:43963)
0812 06:26:26.557607 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:26.557642 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260812 06:26:26.680440 27891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:26.680243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:45877)
0812 06:26:26.680365 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:26.680399 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":59,"threads_started":1}
I20260812 06:26:27.484659 27892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:27.484445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:40053)
0812 06:26:27.484574 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:27.484612 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":73,"threads_started":1}
I20260812 06:26:27.558284 27893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:27.558085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:35803)
0812 06:26:27.558206 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:27.558241 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260812 06:26:27.681031 27895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:27.680833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:56787)
0812 06:26:27.680955 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:27.680989 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260812 06:26:28.485278 27896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:28.485082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:44625)
0812 06:26:28.485197 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:28.485232 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260812 06:26:28.558833 27899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:28.558629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:60395)
0812 06:26:28.558760 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:28.558792 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":80,"threads_started":1}
I20260812 06:26:28.681599 27900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:28.681399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:38217)
0812 06:26:28.681522 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:28.681557 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
I20260812 06:26:29.485930 27902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:29.485739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.65:59283)
0812 06:26:29.485853 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:29.485884 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260812 06:26:29.559468 27903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:29.559285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.66:57023)
0812 06:26:29.559395 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:29.559430 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":59,"threads_started":1}
I20260812 06:26:29.679736 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 26967
I20260812 06:26:29.687325 27906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:29.687111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44411 (local address 127.30.15.67:46447)
0812 06:26:29.687208 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:29.687258 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:44411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":57,"threads_started":1}
I20260812 06:26:29.693198 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 27274
I20260812 06:26:29.710692 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 27531
2026-08-12T06:26:29Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18528 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:26:29 dist-test-slave-gjrz krb5kdc[27913](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:26:29 dist-test-slave-gjrz krb5kdc[27913](info): set up 2 sockets
Aug 12 06:26:29 dist-test-slave-gjrz krb5kdc[27913](info): commencing operation
krb5kdc: starting...
W20260812 06:26:30.909677 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:26:30 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:26:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:26:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:26:31.017721 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:41265
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:41265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:31.097622 27950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:31.097812 27950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:31.097833 27950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:31.098898 27950 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 06:26:31.098930 27950 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 06:26:31.098941 27950 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 06:26:31.098951 27950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:26:31.098963 27950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:31.098980 27950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:31.098994 27950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:26:31.099009 27950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:26:31.100446 27950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:41265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:41265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:31.100627 27950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:31.100796 27950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:31.105616 27957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:31.105697 27958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:31.105675 27950 server_base.cc:1034] running on GCE node
W20260812 06:26:31.105651 27963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:31.106058 27950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:31.106338 27950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:31.107468 27950 hybrid_clock.cc:648] HybridClock initialized: now 1786515991107452 us; error 35 us; skew 500 ppm
Aug 12 06:26:31 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:31.109705 27950 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:26:31.110116 27950 webserver.cc:460] Webserver started at http://127.30.15.126:36197/ using document root <none> and password file <none>
I20260812 06:26:31.110323 27950 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:31.110371 27950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:31.110494 27950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:26:31.111498 27950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "c5e4ad5f15414f73bc6701de75feccf8"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "6af67085a67b74436239b68b9e748b53"
server_key_iv: "78238a33189e243435f46a51b3702fa5"
server_key_version: "encryptionkey@0"
I20260812 06:26:31.111825 27950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "c5e4ad5f15414f73bc6701de75feccf8"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "6af67085a67b74436239b68b9e748b53"
server_key_iv: "78238a33189e243435f46a51b3702fa5"
server_key_version: "encryptionkey@0"
I20260812 06:26:31.112993 27950 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:31.113598 27977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:31.113739 27950 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:26:31.113821 27950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "c5e4ad5f15414f73bc6701de75feccf8"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "6af67085a67b74436239b68b9e748b53"
server_key_iv: "78238a33189e243435f46a51b3702fa5"
server_key_version: "encryptionkey@0"
I20260812 06:26:31.113876 27950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:31.124331 27950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:31.125830 27950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:31.125949 27950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:31.129707 27950 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:41265
I20260812 06:26:31.129737 28070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:41265 every 8 connection(s)
I20260812 06:26:31.130024 27950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:26:31.130831 28077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:31.131731 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 27950
I20260812 06:26:31.131839 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:26:31.132074 30781 external_mini_cluster.cc:1428] Setting key 40dc5aaf8c515e6948139ca1b45ea179
I20260812 06:26:31.133397 28077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Bootstrap starting.
I20260812 06:26:31.134140 28077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:31.134413 28077 log.cc:824] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:31.135061 28077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: No bootstrap required, opened a new log
I20260812 06:26:31.137255 28077 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } }
I20260812 06:26:31.137418 28077 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:31.137465 28077 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5e4ad5f15414f73bc6701de75feccf8, State: Initialized, Role: FOLLOWER
I20260812 06:26:31.137602 28077 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } }
I20260812 06:26:31.137682 28077 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:26:31.137722 28077 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:26:31.137769 28077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:31.138348 28077 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } }
I20260812 06:26:31.138434 28077 leader_election.cc:302] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5e4ad5f15414f73bc6701de75feccf8; no voters:
I20260812 06:26:31.138584 28077 leader_election.cc:288] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [CANDIDATE]: Term 1 election: Requested vote from peers
Aug 12 06:26:31 dist-test-slave-gjrz krb5kdc[27913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515990, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:31.138638 28092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:26:31.138814 28092 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 1 LEADER]: Becoming Leader. State: Replica: c5e4ad5f15414f73bc6701de75feccf8, State: Running, Role: LEADER
I20260812 06:26:31.138864 28077 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:26:31.138935 28092 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } }
I20260812 06:26:31.139532 28093 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5e4ad5f15414f73bc6701de75feccf8. Latest consensus state: current_term: 1 leader_uuid: "c5e4ad5f15414f73bc6701de75feccf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } } }
I20260812 06:26:31.139621 28093 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:31.140002 28114 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:26:31.140398 28098 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5e4ad5f15414f73bc6701de75feccf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } } }
I20260812 06:26:31.140476 28098 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:31.140524 28114 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:26:31.142705 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.132554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50164 (local address 127.30.15.126:41265)
0812 06:26:31.132713 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:31.132719 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:31.132742 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:26:31.133213 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:31.133219 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:31.133263 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:31.133369 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:31.134126 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.135155 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.136172 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.136548 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.136624 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.139196 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:31.139200 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:31.139201 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:31.139212 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:31.141192 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:31.141573 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:31.141575 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:31.141576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:31.141660 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:31.141858 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:31.141859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:31.141859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:31.142168 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:31.142324 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:31.142398 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 06:26:31.142529 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260812 06:26:31.142867 28114 catalog_manager.cc:1347] Generated new cluster ID: 6e8121e9ab8c409488d4cc2d1bff8db2
I20260812 06:26:31.142926 28114 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:26:31.151472 28114 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:26:31.151955 28114 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:26:31.157792 28114 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Generated new TSK 0
I20260812 06:26:31.157934 28114 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:26:31.183904 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41265
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:31.262661 28136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:31.262841 28136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:31.262872 28136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:31.263990 28136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:31.264027 28136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:31.264062 28136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:26:31.265458 28136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:31.265678 28136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:31.265877 28136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:31.270496 28144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:31.270517 28145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:31.270569 28136 server_base.cc:1034] running on GCE node
W20260812 06:26:31.270767 28148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:31.270998 28136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:31.271327 28136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:31.272437 28136 hybrid_clock.cc:648] HybridClock initialized: now 1786515991272414 us; error 39 us; skew 500 ppm
Aug 12 06:26:31 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:31.274955 28136 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:26:31.275380 28136 webserver.cc:460] Webserver started at http://127.30.15.65:39977/ using document root <none> and password file <none>
I20260812 06:26:31.275604 28136 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:31.275652 28136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:31.275774 28136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:26:31.276729 28136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "7b2954cd96ed47e388e89ff06609fa2d"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "16eca33a474acd90da48fe78f4e4eec3"
server_key_iv: "14cdfe3b9d2e7760622ec16cbc23d0a6"
server_key_version: "encryptionkey@0"
I20260812 06:26:31.277046 28136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "7b2954cd96ed47e388e89ff06609fa2d"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "16eca33a474acd90da48fe78f4e4eec3"
server_key_iv: "14cdfe3b9d2e7760622ec16cbc23d0a6"
server_key_version: "encryptionkey@0"
I20260812 06:26:31.278198 28136 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:26:31.278805 28158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:31.278952 28136 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:26:31.279031 28136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "7b2954cd96ed47e388e89ff06609fa2d"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "16eca33a474acd90da48fe78f4e4eec3"
server_key_iv: "14cdfe3b9d2e7760622ec16cbc23d0a6"
server_key_version: "encryptionkey@0"
I20260812 06:26:31.279098 28136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:31.308810 28136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:31.310845 28136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:31.310976 28136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:31.311179 28136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:31.311488 28136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:31.311530 28136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:31.311558 28136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:31.311578 28136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:31.317143 28136 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:33053
I20260812 06:26:31.317215 28396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:33053 every 8 connection(s)
I20260812 06:26:31.317463 28136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:26:31.318444 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 28136
I20260812 06:26:31.318550 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:26:31.318784 30781 external_mini_cluster.cc:1428] Setting key 3cc689106d60e7baf062d452decec4e9
Aug 12 06:26:31 dist-test-slave-gjrz krb5kdc[27913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:31.326717 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.318074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:56319 (local address 127.30.15.126:41265)
0812 06:26:31.318129 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:31.318131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:31.318311 (+ 180us) server_negotiation.cc:407] Connection header received
0812 06:26:31.318951 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:31.318952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:31.318964 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:31.319062 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:31.320188 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.320689 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.321852 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.322172 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.322247 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.324287 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:31.324288 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:31.324288 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:31.324296 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:31.325502 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:31.325856 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:31.325857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:31.325858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:31.325910 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:31.326124 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:31.326125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:31.326126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:31.326233 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:31.326288 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:31.326537 (+ 249us) server_negotiation.cc:299] Negotiation successful
0812 06:26:31.326630 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:26:31.326866 28399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.318043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:56319)
0812 06:26:31.318195 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:31.318235 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:31.318851 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:31.319139 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:31.319143 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:31.319839 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:31.320103 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.320110 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.320771 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.320773 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.321742 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.321745 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.322249 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.322250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.322372 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.322782 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:31.322791 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:31.324202 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:31.325577 (+ 1375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:31.325584 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:31.325587 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:31.325791 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:31.325964 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:31.325965 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:31.325965 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:31.326069 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:31.326288 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:31.326295 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:31.326423 (+ 128us) client_negotiation.cc:769] Sending connection context
0812 06:26:31.326508 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:26:31.326664 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":87,"threads_started":1}
I20260812 06:26:31.327315 28397 heartbeater.cc:347] Connected to a master server at 127.30.15.126:41265
I20260812 06:26:31.327410 28397 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
I20260812 06:26:31.327596 28397 heartbeater.cc:511] Master 127.30.15.126:41265 requested a full tablet report, sending...
I20260812 06:26:31.328091 28009 ts_manager.cc:194] Registered new tserver with Master: 7b2954cd96ed47e388e89ff06609fa2d (127.30.15.65:33053)
I20260812 06:26:31.328730 28009 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:56319
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:26:31.343145 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41265
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:31.422457 28404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:31.422645 28404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:31.422667 28404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:31.423746 28404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:31.423779 28404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:31.423802 28404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:26:31.425141 28404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:31.425323 28404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:31.425487 28404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:31.430176 28421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:31.430212 28404 server_base.cc:1034] running on GCE node
W20260812 06:26:31.430219 28415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:31.430308 28416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:31.430601 28404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:31.430850 28404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:31.432118 28404 hybrid_clock.cc:648] HybridClock initialized: now 1786515991432095 us; error 28 us; skew 500 ppm
Aug 12 06:26:31 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:31.435145 28404 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:26:31.435695 28404 webserver.cc:460] Webserver started at http://127.30.15.66:36211/ using document root <none> and password file <none>
I20260812 06:26:31.435936 28404 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:31.436000 28404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:31.436141 28404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:26:31.437455 28404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "f285cf621cca4d7aa4b94bdb9e53ed15"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "664f8e95c5c082afc3645afaebbedd33"
server_key_iv: "a5df30f9659beef4313437c396afe0d3"
server_key_version: "encryptionkey@0"
I20260812 06:26:31.437865 28404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "f285cf621cca4d7aa4b94bdb9e53ed15"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "664f8e95c5c082afc3645afaebbedd33"
server_key_iv: "a5df30f9659beef4313437c396afe0d3"
server_key_version: "encryptionkey@0"
I20260812 06:26:31.439548 28404 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:26:31.440531 28434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:31.440768 28404 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:31.440857 28404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "f285cf621cca4d7aa4b94bdb9e53ed15"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "664f8e95c5c082afc3645afaebbedd33"
server_key_iv: "a5df30f9659beef4313437c396afe0d3"
server_key_version: "encryptionkey@0"
I20260812 06:26:31.440934 28404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:31.472203 28404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:31.474310 28404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:31.474447 28404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:31.474675 28404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:31.474988 28404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:31.475029 28404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:31.475059 28404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:31.475108 28404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:31.480969 28404 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:39531
I20260812 06:26:31.481025 28686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:39531 every 8 connection(s)
I20260812 06:26:31.481307 28404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:26:31 dist-test-slave-gjrz krb5kdc[27913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:31.487646 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 28404
I20260812 06:26:31.487751 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:26:31.487972 30781 external_mini_cluster.cc:1428] Setting key 4c65a4bfefeaa885e94e70d0c194f719
I20260812 06:26:31.489902 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.482031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:49377 (local address 127.30.15.126:41265)
0812 06:26:31.482083 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:31.482085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:31.482296 (+ 211us) server_negotiation.cc:407] Connection header received
0812 06:26:31.482811 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:31.482812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:31.482823 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:31.482873 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:31.483752 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.484233 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.485187 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.485358 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.485399 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.487343 (+ 1944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:31.487344 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:31.487344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:31.487352 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:31.488705 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:31.489064 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:31.489065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:31.489066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:31.489115 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:31.489323 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:31.489324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:31.489325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:31.489428 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:31.489482 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:31.489740 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 06:26:31.489815 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:26:31.490070 28695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.482021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:49377)
0812 06:26:31.482184 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:31.482219 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:31.482732 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:31.482925 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:31.482928 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:31.483499 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:31.483686 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.483692 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.484298 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.484298 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.485127 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.485130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.485408 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.485409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.485499 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.485913 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:31.485921 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:31.487230 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:31.488780 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:31.488788 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:31.488790 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:31.488992 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:31.489170 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:31.489170 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:31.489171 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:31.489267 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:31.489483 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:31.489490 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:31.489624 (+ 134us) client_negotiation.cc:769] Sending connection context
0812 06:26:31.489711 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 06:26:31.489862 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260812 06:26:31.490688 28691 heartbeater.cc:347] Connected to a master server at 127.30.15.126:41265
I20260812 06:26:31.490780 28691 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:31.490962 28691 heartbeater.cc:511] Master 127.30.15.126:41265 requested a full tablet report, sending...
I20260812 06:26:31.491412 28009 ts_manager.cc:194] Registered new tserver with Master: f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531)
I20260812 06:26:31.491816 28009 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:49377
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:26:31.515529 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41265
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:31.595165 28702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:31.595364 28702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:31.595387 28702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:31.596443 28702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:31.596474 28702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:31.596499 28702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:26:31.597842 28702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:41265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:31.598006 28702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:31.598170 28702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:31.602782 28719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:31.602773 28712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:31.602775 28714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:31.602880 28702 server_base.cc:1034] running on GCE node
I20260812 06:26:31.603144 28702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:31.603384 28702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:31.604537 28702 hybrid_clock.cc:648] HybridClock initialized: now 1786515991604524 us; error 30 us; skew 500 ppm
Aug 12 06:26:31 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:31.606818 28702 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:26:31.607187 28702 webserver.cc:460] Webserver started at http://127.30.15.67:41607/ using document root <none> and password file <none>
I20260812 06:26:31.607390 28702 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:31.607435 28702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:31.607525 28702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:26:31.608456 28702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "b795005794b84901a8c6007a6286c14d"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "cb81b51793637e3952dc7d5bb7b1e408"
server_key_iv: "574e0a2b7c70c5028e900e78744528eb"
server_key_version: "encryptionkey@0"
I20260812 06:26:31.608737 28702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "b795005794b84901a8c6007a6286c14d"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "cb81b51793637e3952dc7d5bb7b1e408"
server_key_iv: "574e0a2b7c70c5028e900e78744528eb"
server_key_version: "encryptionkey@0"
I20260812 06:26:31.609854 28702 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:26:31.610495 28742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:31.610630 28702 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:26:31.610703 28702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "b795005794b84901a8c6007a6286c14d"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "cb81b51793637e3952dc7d5bb7b1e408"
server_key_iv: "574e0a2b7c70c5028e900e78744528eb"
server_key_version: "encryptionkey@0"
I20260812 06:26:31.610765 28702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:31.633273 28702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:31.634843 28702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:31.634996 28702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:31.635195 28702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:31.635494 28702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:31.635527 28702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:31.635547 28702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:31.635571 28702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:31.641494 28702 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:34647
I20260812 06:26:31.641577 28983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:34647 every 8 connection(s)
I20260812 06:26:31.641800 28702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:26:31 dist-test-slave-gjrz krb5kdc[27913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786515991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:31.649865 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.642421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:46783 (local address 127.30.15.126:41265)
0812 06:26:31.642471 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:31.642473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:31.642706 (+ 233us) server_negotiation.cc:407] Connection header received
0812 06:26:31.643220 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:31.643221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:31.643230 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:31.643295 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:31.644163 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.644660 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.645620 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.645808 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.645860 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.647735 (+ 1875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:31.647737 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:31.647737 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:31.647748 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:31.648834 (+ 1086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:31.649180 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:31.649181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:31.649181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:31.649231 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:31.649401 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:31.649402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:31.649402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:31.649507 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:31.649552 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:31.649749 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 06:26:31.649804 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:26:31.649999 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 28702
I20260812 06:26:31.650089 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:26:31.650137 28989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.642410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:46783)
0812 06:26:31.642567 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:31.642614 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:31.643141 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:31.643364 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:31.643368 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:31.643887 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:31.644073 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.644078 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.644725 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.644726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.645550 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.645552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.645869 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.645869 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.645963 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.646387 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:31.646395 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:31.647658 (+ 1263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:31.648907 (+ 1249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:31.648913 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:31.648915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:31.649123 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:31.649276 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:31.649277 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:31.649277 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:31.649361 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:31.649548 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:31.649550 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:31.649656 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 06:26:31.649730 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:26:31.649844 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":68,"threads_started":1}
I20260812 06:26:31.650291 30781 external_mini_cluster.cc:1428] Setting key e1ab9f3db949541378f657719d9bce22
I20260812 06:26:31.650599 28987 heartbeater.cc:347] Connected to a master server at 127.30.15.126:41265
I20260812 06:26:31.650694 28987 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:31.650862 28987 heartbeater.cc:511] Master 127.30.15.126:41265 requested a full tablet report, sending...
I20260812 06:26:31.651187 28009 ts_manager.cc:194] Registered new tserver with Master: b795005794b84901a8c6007a6286c14d (127.30.15.67:34647)
I20260812 06:26:31.651536 28009 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:46783
I20260812 06:26:31.661840 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:26:31.668275 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.663073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50172 (local address 127.30.15.126:41265)
0812 06:26:31.663129 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:31.663131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:31.663191 (+ 60us) server_negotiation.cc:407] Connection header received
0812 06:26:31.663247 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:31.663247 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:31.663257 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:31.663340 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:31.663824 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.664280 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.664972 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.665161 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.665214 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.666234 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:31.666236 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:31.666236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:31.666243 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:31.667205 (+ 962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:31.667537 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:31.667538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:31.667538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:31.667591 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:31.667758 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:31.667758 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:31.667759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:31.667895 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:31.667980 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:31.668123 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 06:26:31.668194 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:26:31.669541 28009 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50172:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:26:31.671027 28009 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:26:31.677165 29008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.673260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:34647 (local address 127.0.0.1:59838)
0812 06:26:31.673622 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:31.673631 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:31.673683 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:31.673901 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:31.673901 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:31.673904 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:31.673946 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.673948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.675317 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.675318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.676188 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.676191 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.676862 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.676863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.676948 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.676964 (+ 16us) client_negotiation.cc:769] Sending connection context
0812 06:26:31.677028 (+ 64us) client_negotiation.cc:240] Negotiation successful
0812 06:26:31.677080 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":1,"thread_start_us":91,"threads_started":1}
I20260812 06:26:31.677222 29015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.673208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41212 (local address 127.30.15.66:39531)
0812 06:26:31.673567 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:31.673572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:31.673582 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:26:31.673623 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:31.673624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:31.673641 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:31.673897 (+ 256us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:31.673981 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.674702 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.676180 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.676909 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.676983 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.677039 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:31.677106 (+ 67us) server_negotiation.cc:299] Negotiation successful
0812 06:26:31.677147 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":89,"threads_started":1}
I20260812 06:26:31.677469 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.673348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59838 (local address 127.30.15.67:34647)
0812 06:26:31.673523 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:31.673527 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:31.673690 (+ 163us) server_negotiation.cc:407] Connection header received
0812 06:26:31.673748 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:31.673750 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:31.673765 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:31.673833 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:31.674022 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.675121 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.676257 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.676783 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.676845 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.676904 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:31.677358 (+ 454us) server_negotiation.cc:299] Negotiation successful
0812 06:26:31.677402 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":67,"threads_started":1}
I20260812 06:26:31.677174 29010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.673076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:39531 (local address 127.0.0.1:41212)
0812 06:26:31.673234 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:31.673279 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:31.673344 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:31.673751 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:31.673754 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:31.673757 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:31.673822 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.673824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.674798 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.674799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.676099 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.676102 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.676981 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.676981 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.677035 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.677038 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:26:31.677084 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 06:26:31.677114 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":42,"threads_started":1}
I20260812 06:26:31.677342 29019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.673086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:33053 (local address 127.0.0.1:52374)
0812 06:26:31.673391 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:31.673400 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:31.673442 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:31.673795 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:31.673796 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:31.673798 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:31.673954 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.673956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.675231 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.675232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.676294 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.676296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.677141 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.677142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.677205 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.677209 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:26:31.677237 (+ 28us) client_negotiation.cc:240] Negotiation successful
0812 06:26:31.677276 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":113,"thread_start_us":74,"threads_started":1}
I20260812 06:26:31.677570 29021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.673445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52374 (local address 127.30.15.65:33053)
0812 06:26:31.673629 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:31.673633 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:31.673641 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:26:31.673679 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:31.673681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:31.673694 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:31.673795 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:31.674037 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.675123 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.676355 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.677048 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.677402 (+ 354us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.677448 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:31.677468 (+ 20us) server_negotiation.cc:299] Negotiation successful
0812 06:26:31.677497 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":85,"threads_started":1}
I20260812 06:26:31.678189 28549 tablet_service.cc:1467] Processing CreateTablet for tablet 5ebf89f3e65f41e691f8333920678447 (DEFAULT_TABLE table=test-table [id=56ef9f6fb6ca4df1b420136a998747ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:31.678567 28549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ebf89f3e65f41e691f8333920678447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:31.678591 28839 tablet_service.cc:1467] Processing CreateTablet for tablet 5ebf89f3e65f41e691f8333920678447 (DEFAULT_TABLE table=test-table [id=56ef9f6fb6ca4df1b420136a998747ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:31.678915 28839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ebf89f3e65f41e691f8333920678447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:31.681391 29023 tablet_bootstrap.cc:492] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d: Bootstrap starting.
I20260812 06:26:31.681380 29022 tablet_bootstrap.cc:492] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15: Bootstrap starting.
I20260812 06:26:31.678161 28253 tablet_service.cc:1467] Processing CreateTablet for tablet 5ebf89f3e65f41e691f8333920678447 (DEFAULT_TABLE table=test-table [id=56ef9f6fb6ca4df1b420136a998747ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:31.681749 28253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ebf89f3e65f41e691f8333920678447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:31.682103 29022 tablet_bootstrap.cc:654] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:31.682253 29023 tablet_bootstrap.cc:654] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:31.682695 29022 log.cc:824] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:31.682806 29023 log.cc:824] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:31.683563 29023 tablet_bootstrap.cc:492] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d: No bootstrap required, opened a new log
I20260812 06:26:31.683640 29023 ts_tablet_manager.cc:1397] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:26:31.683830 29022 tablet_bootstrap.cc:492] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15: No bootstrap required, opened a new log
I20260812 06:26:31.683889 29022 ts_tablet_manager.cc:1397] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:26:31.684926 29028 tablet_bootstrap.cc:492] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Bootstrap starting.
I20260812 06:26:31.685433 29023 raft_consensus.cc:348] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:31.685485 29022 raft_consensus.cc:348] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:31.685633 29023 raft_consensus.cc:374] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:31.685648 29022 raft_consensus.cc:374] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:31.685684 29022 raft_consensus.cc:729] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f285cf621cca4d7aa4b94bdb9e53ed15, State: Initialized, Role: FOLLOWER
I20260812 06:26:31.685684 29023 raft_consensus.cc:729] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b795005794b84901a8c6007a6286c14d, State: Initialized, Role: FOLLOWER
I20260812 06:26:31.685760 29028 tablet_bootstrap.cc:654] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:31.685791 29022 consensus_queue.cc:260] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:31.685819 29023 consensus_queue.cc:260] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:31.686074 28987 heartbeater.cc:503] Master 127.30.15.126:41265 was elected leader, sending a full tablet report...
I20260812 06:26:31.686091 29023 ts_tablet_manager.cc:1428] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 06:26:31.686127 29022 ts_tablet_manager.cc:1428] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:31.686272 28691 heartbeater.cc:503] Master 127.30.15.126:41265 was elected leader, sending a full tablet report...
I20260812 06:26:31.686358 29028 log.cc:824] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:31.687206 29028 tablet_bootstrap.cc:492] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: No bootstrap required, opened a new log
I20260812 06:26:31.687258 29028 ts_tablet_manager.cc:1397] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:31.688587 29028 raft_consensus.cc:348] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:31.688711 29028 raft_consensus.cc:374] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:31.688741 29028 raft_consensus.cc:729] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b2954cd96ed47e388e89ff06609fa2d, State: Initialized, Role: FOLLOWER
I20260812 06:26:31.688844 29028 consensus_queue.cc:260] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:31.689085 29028 ts_tablet_manager.cc:1428] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:26:31.689116 28397 heartbeater.cc:503] Master 127.30.15.126:41265 was elected leader, sending a full tablet report...
W20260812 06:26:31.731873 28693 tablet.cc:2369] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:26:31.818146 28398 tablet.cc:2369] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:26:31.833395 29032 raft_consensus.cc:482] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:26:31.833499 29032 raft_consensus.cc:504] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:31.833822 29032 leader_election.cc:288] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b795005794b84901a8c6007a6286c14d (127.30.15.67:34647), 7b2954cd96ed47e388e89ff06609fa2d (127.30.15.65:33053)
I20260812 06:26:31.837412 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.834122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:39473 (local address 127.30.15.67:34647)
0812 06:26:31.834180 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:31.834182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:31.834276 (+ 94us) server_negotiation.cc:407] Connection header received
0812 06:26:31.834328 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:31.834329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:31.834338 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:31.834388 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:31.834505 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.835184 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.836522 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.837092 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.837147 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.837155 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:31.837304 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 06:26:31.837342 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:26:31.837412 29021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.834017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:35087 (local address 127.30.15.65:33053)
0812 06:26:31.834080 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:31.834082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:31.834092 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:26:31.834148 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:31.834149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:31.834159 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:31.834213 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:31.834378 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.835136 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.836528 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.837069 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.837146 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.837155 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:31.837304 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 06:26:31.837341 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:26:31.837446 28695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.833971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:33053 (local address 127.30.15.66:35087)
0812 06:26:31.834032 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:31.834044 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:31.834094 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:31.834237 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:31.834238 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:31.834240 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:31.834315 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.834317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.835214 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.835215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.836448 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.836451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.837144 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.837145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.837242 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.837244 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:26:31.837294 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:26:31.837340 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":16}
I20260812 06:26:31.837452 29045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.833976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:34647 (local address 127.30.15.66:39473)
0812 06:26:31.834203 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:31.834214 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:31.834273 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:31.834399 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:31.834399 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:31.834401 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:31.834453 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.834454 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.835247 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.835248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.836448 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:31.836451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.837160 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.837161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:31.837239 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.837243 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:26:31.837294 (+ 51us) client_negotiation.cc:240] Negotiation successful
0812 06:26:31.837340 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":79,"thread_start_us":96,"threads_started":1}
I20260812 06:26:31.837774 28293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf89f3e65f41e691f8333920678447" candidate_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b2954cd96ed47e388e89ff06609fa2d" is_pre_election: true
I20260812 06:26:31.837913 28293 raft_consensus.cc:2454] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f285cf621cca4d7aa4b94bdb9e53ed15 in term 0.
I20260812 06:26:31.837877 28874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf89f3e65f41e691f8333920678447" candidate_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b795005794b84901a8c6007a6286c14d" is_pre_election: true
I20260812 06:26:31.838009 28874 raft_consensus.cc:2454] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f285cf621cca4d7aa4b94bdb9e53ed15 in term 0.
I20260812 06:26:31.838129 28437 leader_election.cc:302] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b2954cd96ed47e388e89ff06609fa2d, f285cf621cca4d7aa4b94bdb9e53ed15; no voters:
I20260812 06:26:31.838256 29032 raft_consensus.cc:2781] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:26:31.838313 29032 raft_consensus.cc:482] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:26:31.838335 29032 raft_consensus.cc:3037] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:31.839102 29032 raft_consensus.cc:504] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:31.839214 29032 leader_election.cc:288] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [CANDIDATE]: Term 1 election: Requested vote from peers b795005794b84901a8c6007a6286c14d (127.30.15.67:34647), 7b2954cd96ed47e388e89ff06609fa2d (127.30.15.65:33053)
I20260812 06:26:31.839417 28874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf89f3e65f41e691f8333920678447" candidate_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b795005794b84901a8c6007a6286c14d"
I20260812 06:26:31.839421 28293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf89f3e65f41e691f8333920678447" candidate_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b2954cd96ed47e388e89ff06609fa2d"
I20260812 06:26:31.839488 28293 raft_consensus.cc:3037] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:31.839491 28874 raft_consensus.cc:3037] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:31.840230 28293 raft_consensus.cc:2454] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f285cf621cca4d7aa4b94bdb9e53ed15 in term 1.
I20260812 06:26:31.840325 28874 raft_consensus.cc:2454] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f285cf621cca4d7aa4b94bdb9e53ed15 in term 1.
I20260812 06:26:31.840417 28437 leader_election.cc:302] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b2954cd96ed47e388e89ff06609fa2d, f285cf621cca4d7aa4b94bdb9e53ed15; no voters:
I20260812 06:26:31.840509 29032 raft_consensus.cc:2781] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:26:31.840677 29032 raft_consensus.cc:686] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 1 LEADER]: Becoming Leader. State: Replica: f285cf621cca4d7aa4b94bdb9e53ed15, State: Running, Role: LEADER
I20260812 06:26:31.840770 29032 consensus_queue.cc:237] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:31.841537 28008 catalog_manager.cc:5495] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 reported cstate change: term changed from 0 to 1, leader changed from <none> to f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66). New cstate: current_term: 1 leader_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } health_report { overall_health: UNKNOWN } } }
I20260812 06:26:31.858616 29015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.856540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41218 (local address 127.30.15.66:39531)
0812 06:26:31.856597 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:31.856599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:31.856607 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:26:31.856638 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:31.856639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:31.856656 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:31.856706 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:26:31.856823 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.857255 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.857955 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:31.858140 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:31.858191 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:31.858320 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:26:31.858408 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:26:31.858475 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:31.858511 (+ 36us) server_negotiation.cc:299] Negotiation successful
0812 06:26:31.858536 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260812 06:26:31.860152 28874 raft_consensus.cc:1261] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d [term 1 FOLLOWER]: Refusing update from remote peer f285cf621cca4d7aa4b94bdb9e53ed15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:26:31.860158 28293 raft_consensus.cc:1261] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Refusing update from remote peer f285cf621cca4d7aa4b94bdb9e53ed15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:26:31.860479 29046 consensus_queue.cc:1035] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:26:31.860601 29032 consensus_queue.cc:1035] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:26:31.863077 29054 mvcc.cc:205] Tried to move back new op lower bound from 7317569502657126400 to 7317569502580260864. Current Snapshot: MvccSnapshot[applied={T|T < 7317569502657126400}]
I20260812 06:26:31.865074 28009 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:26:31.865149 28009 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:26:31.865774 28009 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Sending DeleteTablet for 3 replicas of tablet 5ebf89f3e65f41e691f8333920678447
I20260812 06:26:31.866072 28549 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ebf89f3e65f41e691f8333920678447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:31 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:41212
I20260812 06:26:31.866130 28253 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ebf89f3e65f41e691f8333920678447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:31 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:52374
I20260812 06:26:31.866150 28839 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ebf89f3e65f41e691f8333920678447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:31 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:59838
I20260812 06:26:31.866317 29081 tablet_replica.cc:330] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15: stopping tablet replica
I20260812 06:26:31.866348 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 28136
I20260812 06:26:31.866411 29081 raft_consensus.cc:2229] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:26:31.866510 29081 raft_consensus.cc:2258] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:31.874167 29081 ts_tablet_manager.cc:1905] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:26:31.875828 29081 ts_tablet_manager.cc:1918] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:26:31.875901 29081 log.cc:1196] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/5ebf89f3e65f41e691f8333920678447
I20260812 06:26:31.876188 29081 ts_tablet_manager.cc:1939] T 5ebf89f3e65f41e691f8333920678447 P f285cf621cca4d7aa4b94bdb9e53ed15: Deleting consensus metadata
I20260812 06:26:31.876618 27980 catalog_manager.cc:4841] TS f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531): tablet 5ebf89f3e65f41e691f8333920678447 (table test-table [id=56ef9f6fb6ca4df1b420136a998747ff]) successfully deleted
I20260812 06:26:31.883181 29086 tablet_replica.cc:330] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d: stopping tablet replica
I20260812 06:26:31.883317 29086 raft_consensus.cc:2229] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:26:31.883417 29086 raft_consensus.cc:2258] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:31.884684 29086 ts_tablet_manager.cc:1905] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:26:31.885882 29086 ts_tablet_manager.cc:1918] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:26:31.885947 29086 log.cc:1196] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/5ebf89f3e65f41e691f8333920678447
I20260812 06:26:31.886178 29086 ts_tablet_manager.cc:1939] T 5ebf89f3e65f41e691f8333920678447 P b795005794b84901a8c6007a6286c14d: Deleting consensus metadata
I20260812 06:26:31.886524 27980 catalog_manager.cc:4841] TS b795005794b84901a8c6007a6286c14d (127.30.15.67:34647): tablet 5ebf89f3e65f41e691f8333920678447 (table test-table [id=56ef9f6fb6ca4df1b420136a998747ff]) successfully deleted
W20260812 06:26:31.889930 27982 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:33053 (error 108)
I20260812 06:26:31.890213 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 28404
I20260812 06:26:31.890409 29008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:31.890307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:33053 (local address 127.0.0.1:52386)
0812 06:26:31.890353 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:31.890380 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:33053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 06:26:31.916229 27982 catalog_manager.cc:4584] TS 7b2954cd96ed47e388e89ff06609fa2d (127.30.15.65:33053): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5ebf89f3e65f41e691f8333920678447: Network error: Client connection negotiation failed: client connection to 127.30.15.65:33053: connect: Connection refused (error 111)
I20260812 06:26:31.920359 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 28702
I20260812 06:26:31.928351 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 27950
I20260812 06:26:51.941038 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:41265
--webserver_interface=127.30.15.126
--webserver_port=36197
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:41265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:26:52.023012 29090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:52.023196 29090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:52.023216 29090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:52.024333 29090 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 06:26:52.024372 29090 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 06:26:52.024384 29090 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 06:26:52.024394 29090 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:26:52.024408 29090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:52.024433 29090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:52.024457 29090 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:26:52.024479 29090 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:26:52.025918 29090 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:41265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:41265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=36197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:52.026140 29090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:52.026355 29090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:52.035137 29100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:52.035131 29097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:52.035228 29090 server_base.cc:1034] running on GCE node
W20260812 06:26:52.035131 29105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:52.035929 29090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:52.036226 29090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:52.037359 29090 hybrid_clock.cc:648] HybridClock initialized: now 1786516012037343 us; error 32 us; skew 500 ppm
Aug 12 06:26:52 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516012, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:52.039815 29090 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:26:52.040218 29090 webserver.cc:460] Webserver started at http://127.30.15.126:36197/ using document root <none> and password file <none>
I20260812 06:26:52.040434 29090 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:52.040489 29090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:52.041795 29090 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:52.042462 29120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:52.042630 29090 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:52.042712 29090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "c5e4ad5f15414f73bc6701de75feccf8"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "6af67085a67b74436239b68b9e748b53"
server_key_iv: "78238a33189e243435f46a51b3702fa5"
server_key_version: "encryptionkey@0"
I20260812 06:26:52.043068 29090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:52.078217 29090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:52.079960 29090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:52.080101 29090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:52.083880 29090 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:41265
I20260812 06:26:52.083911 29224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:41265 every 8 connection(s)
I20260812 06:26:52.084270 29090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:26:52.085754 29225 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:26:52.086369 29225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Bootstrap starting.
I20260812 06:26:52.087435 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 29090
I20260812 06:26:52.087754 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:33053
--local_ip_for_outbound_sockets=127.30.15.65
--tserver_master_addrs=127.30.15.126:41265
--webserver_port=39977
--webserver_interface=127.30.15.65
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:26:52.095743 29225 log.cc:824] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:52.097452 29225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:26:52.097702 29225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Bootstrap complete.
I20260812 06:26:52.099857 29225 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } }
I20260812 06:26:52.100081 29225 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5e4ad5f15414f73bc6701de75feccf8, State: Initialized, Role: FOLLOWER
I20260812 06:26:52.100224 29225 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } }
I20260812 06:26:52.100278 29225 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:26:52.100322 29225 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:26:52.100369 29225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:26:52.101318 29225 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } }
I20260812 06:26:52.101406 29225 leader_election.cc:302] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5e4ad5f15414f73bc6701de75feccf8; no voters:
I20260812 06:26:52.101547 29225 leader_election.cc:288] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 06:26:52.101600 29243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:26:52.101794 29225 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:26:52.101812 29243 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 2 LEADER]: Becoming Leader. State: Replica: c5e4ad5f15414f73bc6701de75feccf8, State: Running, Role: LEADER
I20260812 06:26:52.102026 29243 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } }
I20260812 06:26:52.102319 29246 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c5e4ad5f15414f73bc6701de75feccf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } } }
I20260812 06:26:52.102393 29246 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:52.102821 29263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:26:52.102802 29247 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5e4ad5f15414f73bc6701de75feccf8. Latest consensus state: current_term: 2 leader_uuid: "c5e4ad5f15414f73bc6701de75feccf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } } }
I20260812 06:26:52.102926 29247 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:26:52.103660 29263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:26:52.103756 29263 catalog_manager.cc:1259] Loaded cluster ID: 6e8121e9ab8c409488d4cc2d1bff8db2
I20260812 06:26:52.103829 29263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:26:52.105299 29263 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:26:52.105541 29263 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Loaded TSK: 0
I20260812 06:26:52.117297 29263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Generated new TSK 1
I20260812 06:26:52.117370 29263 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:26:52.173766 29233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:52.173964 29233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:52.173996 29233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:52.175124 29233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:52.175166 29233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:52.175200 29233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:26:52.176642 29233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:33053
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=39977
--tserver_master_addrs=127.30.15.126:41265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:52.176860 29233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:52.177089 29233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:52.181819 29308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:52.181824 29310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:52.181854 29313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:52.182054 29233 server_base.cc:1034] running on GCE node
I20260812 06:26:52.182250 29233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:52.182482 29233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:52.183663 29233 hybrid_clock.cc:648] HybridClock initialized: now 1786516012183638 us; error 31 us; skew 500 ppm
Aug 12 06:26:52 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516012, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:52.186045 29233 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:26:52.186480 29233 webserver.cc:460] Webserver started at http://127.30.15.65:39977/ using document root <none> and password file <none>
I20260812 06:26:52.186690 29233 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:52.186746 29233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:52.188083 29233 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:26:52.188721 29331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:52.188889 29233 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:26:52.188994 29233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "7b2954cd96ed47e388e89ff06609fa2d"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "16eca33a474acd90da48fe78f4e4eec3"
server_key_iv: "14cdfe3b9d2e7760622ec16cbc23d0a6"
server_key_version: "encryptionkey@0"
I20260812 06:26:52.189301 29233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:52.205291 29233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:52.207108 29233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:52.207230 29233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:52.207486 29233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:52.207922 29345 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 06:26:52.209264 29233 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:26:52.209321 29233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 06:26:52.209343 29233 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 06:26:52.209931 29233 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 06:26:52.209983 29233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 06:26:52.210042 29345 tablet_bootstrap.cc:492] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Bootstrap starting.
I20260812 06:26:52.217612 29233 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:33053
I20260812 06:26:52.218068 29233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:26:52.221829 29345 log.cc:824] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:52.222102 29567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:33053 every 8 connection(s)
I20260812 06:26:52.223472 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 29233
I20260812 06:26:52.223757 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:39531
--local_ip_for_outbound_sockets=127.30.15.66
--tserver_master_addrs=127.30.15.126:41265
--webserver_port=36211
--webserver_interface=127.30.15.66
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:26:52.224532 29345 tablet_bootstrap.cc:492] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:26:52.224785 29345 tablet_bootstrap.cc:492] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Bootstrap complete.
I20260812 06:26:52.225733 29345 ts_tablet_manager.cc:1397] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.012s
Aug 12 06:26:52 dist-test-slave-gjrz krb5kdc[27913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516012, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:52.226699 29345 raft_consensus.cc:348] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:52.226938 29345 raft_consensus.cc:729] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b2954cd96ed47e388e89ff06609fa2d, State: Initialized, Role: FOLLOWER
I20260812 06:26:52.227100 29345 consensus_queue.cc:260] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:52.227365 29345 ts_tablet_manager.cc:1428] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Time spent starting tablet: real 0.002s user 0.002s sys 0.002s
I20260812 06:26:52.230185 29575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.218710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:46307)
0812 06:26:52.219120 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:52.219159 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:52.219714 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:52.220329 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:52.220335 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:52.220707 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:52.221020 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.221028 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.222538 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.222539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.223792 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.223794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.224620 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.224621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.224768 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.225316 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:52.225326 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:52.227059 (+ 1733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:52.228725 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:52.228732 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:52.228734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:52.228948 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:52.229179 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:52.229180 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:52.229180 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:52.229278 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:52.229610 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:52.229617 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:52.229744 (+ 127us) client_negotiation.cc:769] Sending connection context
0812 06:26:52.229827 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 06:26:52.229991 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":89,"threads_started":1}
I20260812 06:26:52.230185 29576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.218952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:46307 (local address 127.30.15.126:41265)
0812 06:26:52.219891 (+ 939us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:52.219899 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:52.219936 (+ 37us) server_negotiation.cc:407] Connection header received
0812 06:26:52.220065 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:52.220071 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:52.220119 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:52.220238 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:52.221160 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.222406 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.223895 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.224496 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.224613 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.227168 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:52.227172 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:52.227172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:52.227182 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:52.228646 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:52.229025 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:52.229028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:52.229029 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:52.229119 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:52.229333 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:52.229334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:52.229334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:52.229546 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:52.229617 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:52.229889 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 06:26:52.230021 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":883,"thread_start_us":63,"threads_started":1}
I20260812 06:26:52.230820 29571 heartbeater.cc:347] Connected to a master server at 127.30.15.126:41265
I20260812 06:26:52.230902 29571 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:52.231058 29571 heartbeater.cc:511] Master 127.30.15.126:41265 requested a full tablet report, sending...
I20260812 06:26:52.231724 29155 ts_manager.cc:194] Registered new tserver with Master: 7b2954cd96ed47e388e89ff06609fa2d (127.30.15.65:33053)
I20260812 06:26:52.232719 29155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:46307
I20260812 06:26:52.233577 29571 heartbeater.cc:503] Master 127.30.15.126:41265 was elected leader, sending a full tablet report...
Aug 12 06:26:52 dist-test-slave-gjrz krb5kdc[27913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516012, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.65@KRBTEST.COM
I20260812 06:26:52.240296 29590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.232248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:33053 (local address 127.0.0.1:60766)
0812 06:26:52.232397 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:52.232440 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:52.232508 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:52.233265 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:52.233273 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:52.233588 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:52.233647 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.233649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.234841 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.234842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.235462 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.235464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.236053 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.236054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.236104 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.236468 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:52.236472 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:52.237604 (+ 1132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:52.239399 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:52.239405 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:52.239407 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:52.239581 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:52.239764 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:52.239764 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:52.239764 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:52.239809 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:52.240066 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:52.240069 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:52.240105 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 06:26:52.240158 (+ 53us) client_negotiation.cc:240] Negotiation successful
0812 06:26:52.240235 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
I20260812 06:26:52.240388 29592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.232980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60766 (local address 127.30.15.65:33053)
0812 06:26:52.233111 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:52.233115 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:52.233124 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:26:52.233153 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:52.233154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:52.233171 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:52.233241 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:52.233745 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.234765 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.235533 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.235985 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.236048 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.237685 (+ 1637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:52.237692 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:52.237692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:52.237699 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:52.239330 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:52.239648 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:52.239650 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:52.239650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:52.239708 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:52.239853 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:52.239853 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:52.239854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:52.240014 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:52.240088 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:52.240210 (+ 122us) server_negotiation.cc:299] Negotiation successful
0812 06:26:52.240300 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260812 06:26:52.240694 29423 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ebf89f3e65f41e691f8333920678447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:31 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:60766
I20260812 06:26:52.241197 29595 tablet_replica.cc:330] stopping tablet replica
I20260812 06:26:52.241292 29595 raft_consensus.cc:2229] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:26:52.241349 29595 raft_consensus.cc:2258] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:52.241605 29595 ts_tablet_manager.cc:1905] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:26:52.243482 29595 ts_tablet_manager.cc:1918] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:26:52.243546 29595 log.cc:1196] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal/wals/5ebf89f3e65f41e691f8333920678447
I20260812 06:26:52.243726 29595 ts_tablet_manager.cc:1939] T 5ebf89f3e65f41e691f8333920678447 P 7b2954cd96ed47e388e89ff06609fa2d: Deleting consensus metadata
I20260812 06:26:52.244138 29123 catalog_manager.cc:4841] TS 7b2954cd96ed47e388e89ff06609fa2d (127.30.15.65:33053): tablet 5ebf89f3e65f41e691f8333920678447 (table test-table [id=56ef9f6fb6ca4df1b420136a998747ff]) successfully deleted
W20260812 06:26:52.308517 29586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:52.308696 29586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:52.308718 29586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:52.309823 29586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:52.309862 29586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:52.309890 29586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:26:52.311316 29586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:39531
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=36211
--tserver_master_addrs=127.30.15.126:41265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:52.311518 29586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:52.311720 29586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:52.316352 29609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:52.316319 29603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:52.316319 29604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:52.316418 29586 server_base.cc:1034] running on GCE node
I20260812 06:26:52.316686 29586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:52.316910 29586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:52.318053 29586 hybrid_clock.cc:648] HybridClock initialized: now 1786516012318042 us; error 27 us; skew 500 ppm
Aug 12 06:26:52 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516012, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:52.320314 29586 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:26:52.320727 29586 webserver.cc:460] Webserver started at http://127.30.15.66:36211/ using document root <none> and password file <none>
I20260812 06:26:52.320910 29586 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:52.320974 29586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:52.322211 29586 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:52.322748 29625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:52.322901 29586 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:26:52.322978 29586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "f285cf621cca4d7aa4b94bdb9e53ed15"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "664f8e95c5c082afc3645afaebbedd33"
server_key_iv: "a5df30f9659beef4313437c396afe0d3"
server_key_version: "encryptionkey@0"
I20260812 06:26:52.323294 29586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:52.330369 29586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:52.332263 29586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:52.332365 29586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:52.332515 29586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:52.332782 29586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:52.332824 29586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:52.332860 29586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:52.332877 29586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:52.339213 29586 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:39531
I20260812 06:26:52.339298 29870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:39531 every 8 connection(s)
I20260812 06:26:52.339588 29586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:26:52.340101 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 29586
I20260812 06:26:52.340389 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:34647
--local_ip_for_outbound_sockets=127.30.15.67
--tserver_master_addrs=127.30.15.126:41265
--webserver_port=41607
--webserver_interface=127.30.15.67
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 06:26:52 dist-test-slave-gjrz krb5kdc[27913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516012, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:52.349596 29576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.340254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:38751 (local address 127.30.15.126:41265)
0812 06:26:52.342084 (+ 1830us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:52.342086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:52.342094 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:26:52.342119 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:52.342120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:52.342131 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:52.342182 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:52.343071 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.343636 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.344675 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.344881 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.344933 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.347134 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:52.347136 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:52.347136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:52.347143 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:52.348384 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:52.348738 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:52.348739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:52.348739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:52.348794 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:52.349003 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:52.349004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:52.349004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:52.349112 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:52.349170 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:52.349416 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 06:26:52.349505 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1804}
I20260812 06:26:52.349741 29884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.340223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:38751)
0812 06:26:52.340384 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:52.340430 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:52.340964 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:52.342275 (+ 1311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:52.342278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:52.342792 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:52.342979 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.342983 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.343719 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.343720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.344591 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.344594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.344947 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.344948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.345070 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.345542 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:52.345550 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:52.347048 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:52.348454 (+ 1406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:52.348461 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:52.348464 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:52.348672 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:52.348847 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:52.348848 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:52.348849 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:52.348947 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:52.349166 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:52.349172 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:52.349302 (+ 130us) client_negotiation.cc:769] Sending connection context
0812 06:26:52.349387 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:26:52.349545 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":83,"threads_started":1}
I20260812 06:26:52.350129 29875 heartbeater.cc:347] Connected to a master server at 127.30.15.126:41265
I20260812 06:26:52.350216 29875 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:52.350373 29875 heartbeater.cc:511] Master 127.30.15.126:41265 requested a full tablet report, sending...
I20260812 06:26:52.350734 29155 ts_manager.cc:194] Registered new tserver with Master: f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531)
I20260812 06:26:52.351086 29155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:38751
W20260812 06:26:52.421373 29885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:26:52.421564 29885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:26:52.421597 29885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:26:52.422701 29885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:26:52.422741 29885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:26:52.422775 29885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:26:52.424258 29885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:34647
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=41607
--tserver_master_addrs=127.30.15.126:41265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:26:52.424487 29885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:26:52.424677 29885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:26:52.429309 29903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:52.429318 29905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:26:52.429335 29907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:26:52.429533 29885 server_base.cc:1034] running on GCE node
I20260812 06:26:52.429775 29885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:26:52.430004 29885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:26:52.431174 29885 hybrid_clock.cc:648] HybridClock initialized: now 1786516012431161 us; error 29 us; skew 500 ppm
Aug 12 06:26:52 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516012, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:26:52.433547 29885 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:26:52.433940 29885 webserver.cc:460] Webserver started at http://127.30.15.67:41607/ using document root <none> and password file <none>
I20260812 06:26:52.434134 29885 fs_manager.cc:359] Metadata directory not provided
I20260812 06:26:52.434196 29885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:26:52.435483 29885 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:52.436092 29917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:52.436256 29885 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:52.436339 29885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "b795005794b84901a8c6007a6286c14d"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "cb81b51793637e3952dc7d5bb7b1e408"
server_key_iv: "574e0a2b7c70c5028e900e78744528eb"
server_key_version: "encryptionkey@0"
I20260812 06:26:52.436635 29885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:26:52.450642 29885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:26:52.452235 29885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:26:52.452365 29885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:26:52.452557 29885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:26:52.452824 29885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:26:52.452857 29885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:52.452893 29885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:26:52.452917 29885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:26:52.458654 29885 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:34647
I20260812 06:26:52.458715 30153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:34647 every 8 connection(s)
I20260812 06:26:52.459026 29885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
Aug 12 06:26:52 dist-test-slave-gjrz krb5kdc[27913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516012, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:26:52.465710 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 29885
I20260812 06:26:52.467542 29576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.459697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:45155 (local address 127.30.15.126:41265)
0812 06:26:52.459774 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:52.459776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:52.459928 (+ 152us) server_negotiation.cc:407] Connection header received
0812 06:26:52.460374 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:52.460375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:52.460386 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:52.460427 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:52.461235 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.461759 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.462722 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.462923 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.462975 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.464871 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:52.464873 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:52.464873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:52.464901 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:52.466114 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:52.466567 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:52.466568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:52.466568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:52.466622 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:52.466876 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:52.466877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:52.466877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:52.466969 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:52.467011 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:52.467359 (+ 348us) server_negotiation.cc:299] Negotiation successful
0812 06:26:52.467447 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":41}
I20260812 06:26:52.467615 30160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.459680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:45155)
0812 06:26:52.459823 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:52.459856 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:52.460290 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:52.460477 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:52.460479 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:52.460994 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:26:52.461170 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.461175 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.461836 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.461836 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.462635 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.462638 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.462986 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.462987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.463100 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.463535 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:26:52.463543 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:26:52.464788 (+ 1245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:26:52.466179 (+ 1391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:52.466188 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:52.466190 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:52.466501 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:52.466681 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:26:52.466682 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:26:52.466683 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:26:52.466816 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:26:52.467021 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:26:52.467026 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:26:52.467183 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 06:26:52.467325 (+ 142us) client_negotiation.cc:240] Negotiation successful
0812 06:26:52.467461 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":81,"threads_started":1}
I20260812 06:26:52.468062 30155 heartbeater.cc:347] Connected to a master server at 127.30.15.126:41265
I20260812 06:26:52.468143 30155 heartbeater.cc:464] Registering TS with master...
I20260812 06:26:52.468303 30155 heartbeater.cc:511] Master 127.30.15.126:41265 requested a full tablet report, sending...
I20260812 06:26:52.468655 29155 ts_manager.cc:194] Registered new tserver with Master: b795005794b84901a8c6007a6286c14d (127.30.15.67:34647)
I20260812 06:26:52.469125 29155 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:45155
I20260812 06:26:52.472235 30162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.466098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58384 (local address 127.30.15.126:41265)
0812 06:26:52.466220 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:52.466222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:52.466376 (+ 154us) server_negotiation.cc:407] Connection header received
0812 06:26:52.466442 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:52.466442 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:52.466452 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:52.466505 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:52.467179 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.467866 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.468737 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.469027 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.469084 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.470128 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:52.470129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:52.470129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:52.470134 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:52.471155 (+ 1021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:52.471492 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:52.471493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:52.471493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:52.471538 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:52.471715 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:52.471715 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:52.471716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:52.471837 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:52.471956 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:52.472113 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 06:26:52.472176 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":104,"thread_start_us":57,"threads_started":1}
I20260812 06:26:52.472905 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:26:52.475181 30162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.473199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58400 (local address 127.30.15.126:41265)
0812 06:26:52.473255 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:52.473256 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:52.473309 (+ 53us) server_negotiation.cc:407] Connection header received
0812 06:26:52.473364 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:52.473364 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:52.473391 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:52.473440 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:26:52.473511 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.473924 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.474630 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.474801 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.474839 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.475002 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:26:52.475035 (+ 33us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 06:26:52.475143 (+ 108us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58400: token expired
Metrics: {"server-negotiator.queue_time_us":36}
W20260812 06:26:52.475234 30162 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58400: token expired
W20260812 06:26:52.475379 28991 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.30.15.126:41265)
I20260812 06:26:52.480319 30162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.475563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58416 (local address 127.30.15.126:41265)
0812 06:26:52.475598 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:52.475600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:52.475607 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:26:52.475645 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:52.475645 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:52.475654 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:52.475698 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:26:52.476132 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.476567 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.477209 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.477386 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.477436 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.478344 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:26:52.478345 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:26:52.478345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:26:52.478352 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:26:52.479392 (+ 1040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:52.479676 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:52.479677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:52.479677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:52.479728 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:26:52.479895 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:26:52.479896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:26:52.479896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:26:52.479994 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:26:52.480071 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:52.480170 (+ 99us) server_negotiation.cc:299] Negotiation successful
0812 06:26:52.480241 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:26:52.481226 29155 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58416:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:26:52.482792 29155 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:26:52.484910 29423 tablet_service.cc:1467] Processing CreateTablet for tablet 5bfac7e8e6904715b2a626c2fc537941 (DEFAULT_TABLE table=test-table [id=68724f6d98e743bfb8b3b46f08807c7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:52.485112 29423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bfac7e8e6904715b2a626c2fc537941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:52.486442 29345 tablet_bootstrap.cc:492] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d: Bootstrap starting.
I20260812 06:26:52.486738 29345 tablet_bootstrap.cc:654] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:52.487658 29345 tablet_bootstrap.cc:492] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d: No bootstrap required, opened a new log
I20260812 06:26:52.487711 29345 ts_tablet_manager.cc:1397] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 06:26:52.487859 29345 raft_consensus.cc:348] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:52.487931 29345 raft_consensus.cc:374] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:52.487978 29345 raft_consensus.cc:729] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b2954cd96ed47e388e89ff06609fa2d, State: Initialized, Role: FOLLOWER
I20260812 06:26:52.488019 29345 consensus_queue.cc:260] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:52.488118 29345 ts_tablet_manager.cc:1428] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 06:26:52.488286 30168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.484565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:39531 (local address 127.0.0.1:43890)
0812 06:26:52.484678 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:52.484685 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:52.484711 (+ 26us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:52.485123 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:52.485124 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:52.485127 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:52.485227 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.485230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.486441 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.486442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.487202 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.487205 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.488078 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.488079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.488144 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.488168 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 06:26:52.488197 (+ 29us) client_negotiation.cc:240] Negotiation successful
0812 06:26:52.488239 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":73,"threads_started":1}
I20260812 06:26:52.488596 30173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.484763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43890 (local address 127.30.15.66:39531)
0812 06:26:52.484962 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:52.484966 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:52.484975 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:26:52.485012 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:52.485014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:52.485030 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:52.485121 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:52.485307 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.486352 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.487324 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.487983 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.488375 (+ 392us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.488445 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:52.488484 (+ 39us) server_negotiation.cc:299] Negotiation successful
0812 06:26:52.488523 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":102,"threads_started":1}
I20260812 06:26:52.488719 29590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.484475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:34647 (local address 127.0.0.1:39896)
0812 06:26:52.484510 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:52.484521 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:52.484551 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:52.484936 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:52.484937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:52.484939 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:52.485004 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.485006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.486399 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.486400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.487482 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.487485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.488497 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.488498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.488567 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.488571 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:26:52.488617 (+ 46us) client_negotiation.cc:240] Negotiation successful
0812 06:26:52.488658 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260812 06:26:52.488749 30169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.484538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39896 (local address 127.30.15.67:34647)
0812 06:26:52.484791 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:52.484794 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:52.484801 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:26:52.484827 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:52.484828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:52.484839 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:52.485080 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:52.485157 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.486308 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.487575 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.488259 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.488331 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.488393 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:52.488646 (+ 253us) server_negotiation.cc:299] Negotiation successful
0812 06:26:52.488686 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":103,"threads_started":1}
I20260812 06:26:52.489429 29712 tablet_service.cc:1467] Processing CreateTablet for tablet 5bfac7e8e6904715b2a626c2fc537941 (DEFAULT_TABLE table=test-table [id=68724f6d98e743bfb8b3b46f08807c7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:52.489427 30013 tablet_service.cc:1467] Processing CreateTablet for tablet 5bfac7e8e6904715b2a626c2fc537941 (DEFAULT_TABLE table=test-table [id=68724f6d98e743bfb8b3b46f08807c7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:26:52.489758 29712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bfac7e8e6904715b2a626c2fc537941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:52.489756 30013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bfac7e8e6904715b2a626c2fc537941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:26:52.493126 30177 tablet_bootstrap.cc:492] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15: Bootstrap starting.
I20260812 06:26:52.493772 30177 tablet_bootstrap.cc:654] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:52.494233 30177 log.cc:824] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:52.494513 30178 tablet_bootstrap.cc:492] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d: Bootstrap starting.
I20260812 06:26:52.494870 30177 tablet_bootstrap.cc:492] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15: No bootstrap required, opened a new log
I20260812 06:26:52.494926 30177 ts_tablet_manager.cc:1397] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:26:52.495041 30178 tablet_bootstrap.cc:654] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d: Neither blocks nor log segments found. Creating new log.
I20260812 06:26:52.495522 30178 log.cc:824] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:26:52.496140 30178 tablet_bootstrap.cc:492] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d: No bootstrap required, opened a new log
I20260812 06:26:52.496197 30178 ts_tablet_manager.cc:1397] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:26:52.496388 30177 raft_consensus.cc:348] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:52.496526 30177 raft_consensus.cc:374] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:52.496546 30177 raft_consensus.cc:729] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f285cf621cca4d7aa4b94bdb9e53ed15, State: Initialized, Role: FOLLOWER
I20260812 06:26:52.496650 30177 consensus_queue.cc:260] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:52.496903 30177 ts_tablet_manager.cc:1428] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:26:52.497004 29875 heartbeater.cc:503] Master 127.30.15.126:41265 was elected leader, sending a full tablet report...
I20260812 06:26:52.497810 30178 raft_consensus.cc:348] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:52.497933 30178 raft_consensus.cc:374] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:26:52.497963 30178 raft_consensus.cc:729] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b795005794b84901a8c6007a6286c14d, State: Initialized, Role: FOLLOWER
I20260812 06:26:52.498070 30178 consensus_queue.cc:260] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:52.498291 30178 ts_tablet_manager.cc:1428] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:26:52.498308 30155 heartbeater.cc:503] Master 127.30.15.126:41265 was elected leader, sending a full tablet report...
W20260812 06:26:52.590145 29881 tablet.cc:2369] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:26:52.661733 30189 raft_consensus.cc:482] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:26:52.661860 30189 raft_consensus.cc:504] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:52.662227 30189 leader_election.cc:288] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531), 7b2954cd96ed47e388e89ff06609fa2d (127.30.15.65:33053)
I20260812 06:26:52.665609 29592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.662609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:46649 (local address 127.30.15.65:33053)
0812 06:26:52.662668 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:52.662670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:52.662680 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:26:52.662710 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:52.662711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:52.662739 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:52.662807 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:52.663019 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.663600 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.664690 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.665291 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.665350 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.665423 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:52.665492 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 06:26:52.665538 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:26:52.665608 30173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.662486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:34715 (local address 127.30.15.66:39531)
0812 06:26:52.662557 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:52.662559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:52.662814 (+ 255us) server_negotiation.cc:407] Connection header received
0812 06:26:52.662846 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:52.662847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:52.662857 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:52.662940 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:26:52.663109 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.663646 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.664666 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.665244 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.665324 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.665336 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:52.665503 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 06:26:52.665546 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:26:52.665642 30160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.662415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:33053 (local address 127.30.15.67:46649)
0812 06:26:52.662504 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:52.662517 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:52.662568 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:52.662848 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:52.662849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:52.662851 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:52.662936 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.662938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.663672 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.663673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.664579 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.664582 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.665358 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.665359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.665429 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.665431 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:26:52.665485 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:26:52.665534 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":34}
I20260812 06:26:52.665649 30191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.662417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:39531 (local address 127.30.15.67:34715)
0812 06:26:52.662706 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:52.662716 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:26:52.662783 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:26:52.662948 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:26:52.662948 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:26:52.662950 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:26:52.663041 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.663043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.663732 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.663733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.664578 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:26:52.664580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.665333 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.665335 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:26:52.665424 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.665428 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:26:52.665486 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:26:52.665534 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":105,"thread_start_us":133,"threads_started":1}
I20260812 06:26:52.665997 29472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfac7e8e6904715b2a626c2fc537941" candidate_uuid: "b795005794b84901a8c6007a6286c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b2954cd96ed47e388e89ff06609fa2d" is_pre_election: true
I20260812 06:26:52.666155 29472 raft_consensus.cc:2454] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b795005794b84901a8c6007a6286c14d in term 0.
I20260812 06:26:52.666133 29771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfac7e8e6904715b2a626c2fc537941" candidate_uuid: "b795005794b84901a8c6007a6286c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" is_pre_election: true
I20260812 06:26:52.666255 29771 raft_consensus.cc:2454] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b795005794b84901a8c6007a6286c14d in term 0.
I20260812 06:26:52.666394 29919 leader_election.cc:302] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b2954cd96ed47e388e89ff06609fa2d, b795005794b84901a8c6007a6286c14d; no voters:
I20260812 06:26:52.666523 30189 raft_consensus.cc:2781] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:26:52.666600 30189 raft_consensus.cc:482] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:26:52.666630 30189 raft_consensus.cc:3037] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:52.667409 30189 raft_consensus.cc:504] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:52.667532 30189 leader_election.cc:288] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [CANDIDATE]: Term 1 election: Requested vote from peers f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531), 7b2954cd96ed47e388e89ff06609fa2d (127.30.15.65:33053)
I20260812 06:26:52.667678 29472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfac7e8e6904715b2a626c2fc537941" candidate_uuid: "b795005794b84901a8c6007a6286c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b2954cd96ed47e388e89ff06609fa2d"
I20260812 06:26:52.667680 29771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfac7e8e6904715b2a626c2fc537941" candidate_uuid: "b795005794b84901a8c6007a6286c14d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15"
I20260812 06:26:52.667754 29771 raft_consensus.cc:3037] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:52.667757 29472 raft_consensus.cc:3037] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:26:52.668468 29472 raft_consensus.cc:2454] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b795005794b84901a8c6007a6286c14d in term 1.
I20260812 06:26:52.668473 29771 raft_consensus.cc:2454] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b795005794b84901a8c6007a6286c14d in term 1.
I20260812 06:26:52.668637 29918 leader_election.cc:302] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b795005794b84901a8c6007a6286c14d, f285cf621cca4d7aa4b94bdb9e53ed15; no voters:
I20260812 06:26:52.668715 30189 raft_consensus.cc:2781] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:26:52.668833 30189 raft_consensus.cc:686] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 1 LEADER]: Becoming Leader. State: Replica: b795005794b84901a8c6007a6286c14d, State: Running, Role: LEADER
I20260812 06:26:52.668905 30189 consensus_queue.cc:237] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:26:52.669704 29155 catalog_manager.cc:5495] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d reported cstate change: term changed from 0 to 1, leader changed from <none> to b795005794b84901a8c6007a6286c14d (127.30.15.67). New cstate: current_term: 1 leader_uuid: "b795005794b84901a8c6007a6286c14d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } health_report { overall_health: UNKNOWN } } }
W20260812 06:26:52.709539 30159 tablet.cc:2369] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:26:52.713114 30169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.711123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39900 (local address 127.30.15.67:34647)
0812 06:26:52.711163 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:26:52.711165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:26:52.711172 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:26:52.711216 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:26:52.711217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:26:52.711233 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:26:52.711320 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:26:52.711420 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.711851 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.712519 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:26:52.712693 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:26:52.712735 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:26:52.712831 (+ 96us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:26:52.712919 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:26:52.712973 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:26:52.713005 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 06:26:52.713020 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:26:52.714732 29472 raft_consensus.cc:1261] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Refusing update from remote peer b795005794b84901a8c6007a6286c14d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:26:52.714732 29771 raft_consensus.cc:1261] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 1 FOLLOWER]: Refusing update from remote peer b795005794b84901a8c6007a6286c14d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:26:52.715051 30189 consensus_queue.cc:1035] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:26:52.715181 30194 consensus_queue.cc:1035] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:26:52.716883 30206 mvcc.cc:205] Tried to move back new op lower bound from 7317569588077101056 to 7317569587892457472. Current Snapshot: MvccSnapshot[applied={T|T < 7317569588077101056}]
I20260812 06:26:52.718252 30207 mvcc.cc:205] Tried to move back new op lower bound from 7317569588077101056 to 7317569587892457472. Current Snapshot: MvccSnapshot[applied={T|T < 7317569588077101056}]
I20260812 06:26:52.719309 29155 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58416:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:26:52.719400 29155 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58416:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:26:52.720075 29155 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Sending DeleteTablet for 3 replicas of tablet 5bfac7e8e6904715b2a626c2fc537941
I20260812 06:26:52.720360 29423 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bfac7e8e6904715b2a626c2fc537941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:52 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:60766
I20260812 06:26:52.720405 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 29233
I20260812 06:26:52.720446 29595 tablet_replica.cc:330] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d: stopping tablet replica
I20260812 06:26:52.720489 29595 raft_consensus.cc:2229] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:26:52.720448 29712 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bfac7e8e6904715b2a626c2fc537941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:52 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:43890
I20260812 06:26:52.720522 29595 raft_consensus.cc:2258] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:52.720718 30013 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bfac7e8e6904715b2a626c2fc537941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:26:52 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:39896
I20260812 06:26:52.731932 30219 tablet_replica.cc:330] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15: stopping tablet replica
I20260812 06:26:52.732087 30222 tablet_replica.cc:330] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d: stopping tablet replica
I20260812 06:26:52.733270 30222 raft_consensus.cc:2229] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:26:52.733412 30219 raft_consensus.cc:2229] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:26:52.733569 30222 raft_consensus.cc:2258] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:52.733711 30219 raft_consensus.cc:2258] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:26:52.735002 30222 ts_tablet_manager.cc:1905] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:26:52.735306 30219 ts_tablet_manager.cc:1905] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:26:52.736968 30219 ts_tablet_manager.cc:1918] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:26:52.737056 30219 log.cc:1196] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/5bfac7e8e6904715b2a626c2fc537941
I20260812 06:26:52.737361 30219 ts_tablet_manager.cc:1939] T 5bfac7e8e6904715b2a626c2fc537941 P f285cf621cca4d7aa4b94bdb9e53ed15: Deleting consensus metadata
I20260812 06:26:52.738081 29121 catalog_manager.cc:4841] TS f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531): tablet 5bfac7e8e6904715b2a626c2fc537941 (table test-table [id=68724f6d98e743bfb8b3b46f08807c7e]) successfully deleted
I20260812 06:26:52.738468 30222 ts_tablet_manager.cc:1918] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:26:52.738533 30222 log.cc:1196] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/5bfac7e8e6904715b2a626c2fc537941
I20260812 06:26:52.738778 30222 ts_tablet_manager.cc:1939] T 5bfac7e8e6904715b2a626c2fc537941 P b795005794b84901a8c6007a6286c14d: Deleting consensus metadata
I20260812 06:26:52.739133 29121 catalog_manager.cc:4841] TS b795005794b84901a8c6007a6286c14d (127.30.15.67:34647): tablet 5bfac7e8e6904715b2a626c2fc537941 (table test-table [id=68724f6d98e743bfb8b3b46f08807c7e]) successfully deleted
W20260812 06:26:52.741608 29123 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:33053 (error 108)
I20260812 06:26:52.741914 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 29586
I20260812 06:26:52.742077 29590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:26:52.741947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:33053 (local address 127.0.0.1:60778)
0812 06:26:52.741997 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:26:52.742041 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:33053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 06:26:52.743778 29123 catalog_manager.cc:4584] TS 7b2954cd96ed47e388e89ff06609fa2d (127.30.15.65:33053): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5bfac7e8e6904715b2a626c2fc537941: Network error: Client connection negotiation failed: client connection to 127.30.15.65:33053: connect: Connection refused (error 111)
I20260812 06:26:52.755138 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 29885
I20260812 06:26:52.763623 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 29090
I20260812 06:27:12.779529 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:41265
--webserver_interface=127.30.15.126
--webserver_port=36197
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:41265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:12.860756 30227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:12.860946 30227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:12.860967 30227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:12.862149 30227 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 06:27:12.862190 30227 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 06:27:12.862202 30227 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 06:27:12.862213 30227 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:12.862226 30227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:12.862250 30227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:12.862273 30227 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:12.862287 30227 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:12.863852 30227 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:41265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:41265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=36197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:12.864074 30227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:12.864288 30227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:12.868825 30242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:12.868940 30227 server_base.cc:1034] running on GCE node
W20260812 06:27:12.868871 30238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:12.868858 30237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:12.869299 30227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:12.869585 30227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:12.870726 30227 hybrid_clock.cc:648] HybridClock initialized: now 1786516032870713 us; error 27 us; skew 500 ppm
Aug 12 06:27:12 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516032, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:12.873078 30227 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:27:12.873528 30227 webserver.cc:460] Webserver started at http://127.30.15.126:36197/ using document root <none> and password file <none>
I20260812 06:27:12.873739 30227 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:12.873792 30227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:12.875066 30227 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:27:12.875716 30256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:12.875852 30227 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:12.875931 30227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "c5e4ad5f15414f73bc6701de75feccf8"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "6af67085a67b74436239b68b9e748b53"
server_key_iv: "78238a33189e243435f46a51b3702fa5"
server_key_version: "encryptionkey@0"
I20260812 06:27:12.876228 30227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:12.889642 30227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:12.891228 30227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:12.891413 30227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:12.895219 30227 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:41265
I20260812 06:27:12.895298 30347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:41265 every 8 connection(s)
I20260812 06:27:12.895619 30227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:12.896975 30348 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:27:12.897596 30348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Bootstrap starting.
I20260812 06:27:12.905331 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 30227
I20260812 06:27:12.905615 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:33053
--local_ip_for_outbound_sockets=127.30.15.65
--tserver_master_addrs=127.30.15.126:41265
--webserver_port=39977
--webserver_interface=127.30.15.65
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:27:12.906682 30348 log.cc:824] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:12.909389 30348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:27:12.909662 30348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Bootstrap complete.
I20260812 06:27:12.911901 30348 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } }
I20260812 06:27:12.912139 30348 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5e4ad5f15414f73bc6701de75feccf8, State: Initialized, Role: FOLLOWER
I20260812 06:27:12.912295 30348 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } }
I20260812 06:27:12.912372 30348 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:12.912420 30348 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:12.912467 30348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:27:12.913424 30348 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } }
I20260812 06:27:12.913522 30348 leader_election.cc:302] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5e4ad5f15414f73bc6701de75feccf8; no voters:
I20260812 06:27:12.913678 30348 leader_election.cc:288] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 06:27:12.913727 30356 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:27:12.913889 30356 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [term 3 LEADER]: Becoming Leader. State: Replica: c5e4ad5f15414f73bc6701de75feccf8, State: Running, Role: LEADER
I20260812 06:27:12.913987 30348 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:12.914042 30356 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } }
I20260812 06:27:12.914342 30356 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5e4ad5f15414f73bc6701de75feccf8. Latest consensus state: current_term: 3 leader_uuid: "c5e4ad5f15414f73bc6701de75feccf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } } }
I20260812 06:27:12.914433 30356 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:12.914845 30365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:12.915374 30358 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c5e4ad5f15414f73bc6701de75feccf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4ad5f15414f73bc6701de75feccf8" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41265 } } }
I20260812 06:27:12.915575 30358 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:12.915738 30365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:12.915848 30365 catalog_manager.cc:1259] Loaded cluster ID: 6e8121e9ab8c409488d4cc2d1bff8db2
I20260812 06:27:12.915880 30365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:12.917076 30365 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:12.917261 30365 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Loaded TSK: 0
I20260812 06:27:12.917303 30365 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c5e4ad5f15414f73bc6701de75feccf8: Loaded TSK: 1
F20260812 06:27:12.917518 30365 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f63650249ad google::LogMessage::Fail() at ??:0
@ 0x7f636502788a google::LogMessage::SendToLog() at ??:0
@ 0x7f63650244de google::LogMessage::Flush() at ??:0
@ 0x7f6365025a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6367791104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f636778ed41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f636cf7e1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f636cf7e48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f636cf7e594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f636cf44c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f636cf4ead0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f6366ef20d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6366ee7954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f6367d4b6db start_thread at ??:0
@ 0x7f6363b2261f clone at ??:0
W20260812 06:27:13.001945 30354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:13.002137 30354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:13.002174 30354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:13.003319 30354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:13.003358 30354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:13.003393 30354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:27:13.004813 30354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:33053
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=39977
--tserver_master_addrs=127.30.15.126:41265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:13.005043 30354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:13.005259 30354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:13.009972 30433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:13.009938 30434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:13.010149 30437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:13.010227 30354 server_base.cc:1034] running on GCE node
I20260812 06:27:13.010397 30354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:13.010623 30354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:13.011765 30354 hybrid_clock.cc:648] HybridClock initialized: now 1786516033011749 us; error 31 us; skew 500 ppm
Aug 12 06:27:13 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516033, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:13.014066 30354 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:27:13.014474 30354 webserver.cc:460] Webserver started at http://127.30.15.65:39977/ using document root <none> and password file <none>
I20260812 06:27:13.014696 30354 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:13.014740 30354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:13.016005 30354 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:27:13.016613 30452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:13.016791 30354 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:27:13.016899 30354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "7b2954cd96ed47e388e89ff06609fa2d"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "16eca33a474acd90da48fe78f4e4eec3"
server_key_iv: "14cdfe3b9d2e7760622ec16cbc23d0a6"
server_key_version: "encryptionkey@0"
I20260812 06:27:13.017306 30354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:13.031924 30354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:13.034201 30354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:13.034349 30354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:13.034614 30354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:13.035120 30466 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260812 06:27:13.036620 30354 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:27:13.036681 30354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260812 06:27:13.036715 30354 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 06:27:13.037600 30354 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 06:27:13.037643 30354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260812 06:27:13.037698 30466 tablet_bootstrap.cc:492] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d: Bootstrap starting.
I20260812 06:27:13.045006 30354 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:33053
I20260812 06:27:13.045228 30675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:33053 every 8 connection(s)
I20260812 06:27:13.045457 30354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:27:13.049240 30466 log.cc:824] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:13.051234 30466 tablet_bootstrap.cc:492] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:27:13.051530 30466 tablet_bootstrap.cc:492] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d: Bootstrap complete.
I20260812 06:27:13.051870 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 30354
I20260812 06:27:13.052162 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:39531
--local_ip_for_outbound_sockets=127.30.15.66
--tserver_master_addrs=127.30.15.126:41265
--webserver_port=36211
--webserver_interface=127.30.15.66
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:27:13.052505 30466 ts_tablet_manager.cc:1397] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.007s
I20260812 06:27:13.053486 30466 raft_consensus.cc:348] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:27:13.053709 30466 raft_consensus.cc:729] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b2954cd96ed47e388e89ff06609fa2d, State: Initialized, Role: FOLLOWER
I20260812 06:27:13.053864 30466 consensus_queue.cc:260] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:27:13.054147 30466 ts_tablet_manager.cc:1428] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260812 06:27:13.110299 30681 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:27:13.046152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:53889)
0812 06:27:13.046481 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:13.046540 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:13.047178 (+ 638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:13.110055 (+ 62877us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":107,"threads_started":1}
W20260812 06:27:13.110564 30676 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:41265 (0 consecutive failures): Network error: Failed to ping master at 127.30.15.126:41265: Client connection negotiation failed: client connection to 127.30.15.126:41265: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:27:13.110926 30681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:13.110802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:46213)
0812 06:27:13.110855 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:13.110901 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260812 06:27:13.111377 30681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:13.111289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:48423)
0812 06:27:13.111327 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:13.111354 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260812 06:27:13.111488 30676 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:27:13.136016 30686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:13.136197 30686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:13.136219 30686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:13.137292 30686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:13.137324 30686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:13.137348 30686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:27:13.138751 30686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:39531
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=36211
--tserver_master_addrs=127.30.15.126:41265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:13.138927 30686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:13.139132 30686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:13.143812 30697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:13.143833 30703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:13.143834 30696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:13.143915 30686 server_base.cc:1034] running on GCE node
I20260812 06:27:13.144165 30686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:13.144398 30686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:13.145557 30686 hybrid_clock.cc:648] HybridClock initialized: now 1786516033145542 us; error 28 us; skew 500 ppm
Aug 12 06:27:13 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516033, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:13.148028 30686 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:27:13.148432 30686 webserver.cc:460] Webserver started at http://127.30.15.66:36211/ using document root <none> and password file <none>
I20260812 06:27:13.148645 30686 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:13.148695 30686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:13.149932 30686 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:27:13.150439 30725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:13.150592 30686 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:13.150672 30686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "f285cf621cca4d7aa4b94bdb9e53ed15"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "664f8e95c5c082afc3645afaebbedd33"
server_key_iv: "a5df30f9659beef4313437c396afe0d3"
server_key_version: "encryptionkey@0"
I20260812 06:27:13.150995 30686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:13.166873 30686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:13.168625 30686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:13.168763 30686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:13.168969 30686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:13.169250 30686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:13.169283 30686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:13.169310 30686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:13.169328 30686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:13.174947 30686 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:39531
I20260812 06:27:13.175004 30960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:39531 every 8 connection(s)
I20260812 06:27:13.175335 30686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:27:13.176296 30964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:13.175946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:41269)
0812 06:27:13.176095 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:13.176162 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":81,"threads_started":1}
W20260812 06:27:13.176631 30962 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:41265 (0 consecutive failures): Network error: Failed to ping master at 127.30.15.126:41265: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
I20260812 06:27:13.176857 30964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:13.176789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:45655)
0812 06:27:13.176816 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:13.176841 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
I20260812 06:27:13.177101 30964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:13.177039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:43839)
0812 06:27:13.177070 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:13.177088 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260812 06:27:13.177179 30962 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:27:13.178153 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 30686
I20260812 06:27:13.178433 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:34647
--local_ip_for_outbound_sockets=127.30.15.67
--tserver_master_addrs=127.30.15.126:41265
--webserver_port=41607
--webserver_interface=127.30.15.67
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:40127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:13.259220 30965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:13.259438 30965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:13.259459 30965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:13.260560 30965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:13.260598 30965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:13.260622 30965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:27:13.262042 30965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:40127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:34647
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=41607
--tserver_master_addrs=127.30.15.126:41265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:13.262267 30965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:13.262452 30965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:13.267099 30979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:13.267153 30978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:13.267086 30983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:13.267202 30965 server_base.cc:1034] running on GCE node
I20260812 06:27:13.267517 30965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:13.267737 30965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:13.268874 30965 hybrid_clock.cc:648] HybridClock initialized: now 1786516033268861 us; error 29 us; skew 500 ppm
Aug 12 06:27:13 dist-test-slave-gjrz krb5kdc[27913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516033, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:13.271215 30965 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:27:13.271613 30965 webserver.cc:460] Webserver started at http://127.30.15.67:41607/ using document root <none> and password file <none>
I20260812 06:27:13.271821 30965 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:13.271864 30965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:13.273046 30965 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:27:13.273556 30994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:13.273680 30965 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:13.273767 30965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "b795005794b84901a8c6007a6286c14d"
format_stamp: "Formatted at 2026-08-12 06:26:31 on dist-test-slave-gjrz"
server_key: "cb81b51793637e3952dc7d5bb7b1e408"
server_key_iv: "574e0a2b7c70c5028e900e78744528eb"
server_key_version: "encryptionkey@0"
I20260812 06:27:13.274062 30965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:13.282614 30965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:13.284277 30965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:13.284394 30965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:13.284577 30965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:13.284840 30965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:13.284873 30965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:13.284898 30965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:13.284922 30965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:13.290469 30965 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:34647
I20260812 06:27:13.290524 31190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:34647 every 8 connection(s)
I20260812 06:27:13.290793 30965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:27:13.291697 31195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:13.291361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:59507)
0812 06:27:13.291509 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:13.291571 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
W20260812 06:27:13.292042 31193 heartbeater.cc:644] Failed to heartbeat to 127.30.15.126:41265 (0 consecutive failures): Network error: Failed to ping master at 127.30.15.126:41265: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
I20260812 06:27:13.292270 31195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:13.292192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:59281)
0812 06:27:13.292228 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:13.292252 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 06:27:13.292462 31195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:13.292415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:54005)
0812 06:27:13.292435 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:13.292451 (+ 16us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260812 06:27:13.292543 31193 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:27:13.293771 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 30965
I20260812 06:27:14.112049 31199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:14.111799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:35969)
0812 06:27:14.111946 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:14.111981 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":67,"threads_started":1}
I20260812 06:27:14.177659 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:14.177449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:36737)
0812 06:27:14.177575 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:14.177608 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":63,"threads_started":1}
I20260812 06:27:14.293010 31201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:14.292819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:57867)
0812 06:27:14.292927 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:14.292958 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":56,"threads_started":1}
I20260812 06:27:14.872972 31203 raft_consensus.cc:482] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:27:14.873095 31203 raft_consensus.cc:504] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:27:14.873370 31203 leader_election.cc:288] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b795005794b84901a8c6007a6286c14d (127.30.15.67:34647), f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531)
Aug 12 06:27:14 dist-test-slave-gjrz krb5kdc[27913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516033, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.66@KRBTEST.COM
Aug 12 06:27:14 dist-test-slave-gjrz krb5kdc[27913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516033, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.67@KRBTEST.COM
I20260812 06:27:14.883163 31205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:14.873626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:54069 (local address 127.30.15.67:34647)
0812 06:27:14.873841 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:14.873854 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:14.873882 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:27:14.874349 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:14.874352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:14.874394 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:14.874524 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:14.875296 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:14.876200 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:14.877206 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:14.877603 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:14.877707 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:14.880289 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:14.880293 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:14.880293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:14.880304 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:14.881685 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:14.882055 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:14.882058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:14.882058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:14.882139 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:14.882370 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:14.882371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:14.882371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:14.882597 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:14.882667 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:14.882933 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 06:27:14.883047 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":58,"threads_started":1}
I20260812 06:27:14.883155 31207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:14.873695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:39531 (local address 127.30.15.65:37219)
0812 06:27:14.873795 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:14.873806 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:14.873864 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:14.874583 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:14.874584 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:14.874959 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:14.875164 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:14.875169 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:14.876304 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:14.876305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:14.877149 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:14.877152 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:14.877690 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:14.877692 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:14.877803 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:14.878292 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:27:14.878299 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:14.879815 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:14.881639 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:14.881646 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:14.881648 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:14.881952 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:14.882198 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:14.882198 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:14.882199 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:14.882308 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:14.882663 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:14.882670 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:14.882786 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 06:27:14.882871 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 06:27:14.883058 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"mutex_wait_us":45,"thread_start_us":38,"threads_started":1}
I20260812 06:27:14.883164 31208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:14.873829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:37219 (local address 127.30.15.66:39531)
0812 06:27:14.873980 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:14.873989 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:14.874006 (+ 17us) server_negotiation.cc:407] Connection header received
0812 06:27:14.874433 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:14.874435 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:14.874470 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:14.874585 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:14.875303 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:14.876232 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:14.877225 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:14.877611 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:14.877705 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:14.879934 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:14.879938 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:14.879938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:14.879950 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:14.881559 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:14.882031 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:14.882035 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:14.882035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:14.882136 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:14.882368 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:14.882369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:14.882370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:14.882598 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:14.882669 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:14.882936 (+ 267us) server_negotiation.cc:299] Negotiation successful
0812 06:27:14.883059 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
I20260812 06:27:14.883335 31204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:14.873519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:34647 (local address 127.30.15.65:54069)
0812 06:27:14.873644 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:14.873654 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:14.873715 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:14.874573 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:14.874576 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:14.874957 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:14.875164 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:14.875169 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:14.876296 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:14.876297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:14.877142 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:14.877145 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:14.877683 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:14.877684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:14.877802 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:14.878337 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:27:14.878342 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:14.880200 (+ 1858us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:14.881761 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:14.881762 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:14.881762 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:14.881981 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:14.882200 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:14.882201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:14.882201 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:14.882310 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:14.882663 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:14.882670 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:14.882787 (+ 117us) client_negotiation.cc:769] Sending connection context
0812 06:27:14.882871 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 06:27:14.883128 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":174,"thread_start_us":62,"threads_started":1}
W20260812 06:27:14.883956 30454 leader_election.cc:341] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531): Not found: Tablet not found: 5bfac7e8e6904715b2a626c2fc537941
W20260812 06:27:14.884104 30454 leader_election.cc:341] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b795005794b84901a8c6007a6286c14d (127.30.15.67:34647): Not found: Tablet not found: 5bfac7e8e6904715b2a626c2fc537941
I20260812 06:27:14.884162 30454 leader_election.cc:302] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b2954cd96ed47e388e89ff06609fa2d; no voters: b795005794b84901a8c6007a6286c14d, f285cf621cca4d7aa4b94bdb9e53ed15
I20260812 06:27:14.884258 31203 raft_consensus.cc:2726] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:27:15.112625 31207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:15.112475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:57587)
0812 06:27:15.112525 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:15.112581 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:27:15.178186 31210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:15.177963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:57143)
0812 06:27:15.178098 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:15.178140 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":82,"threads_started":1}
I20260812 06:27:15.293604 31212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:15.293376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:54687)
0812 06:27:15.293508 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:15.293558 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
I20260812 06:27:16.113246 31217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:16.113018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:49841)
0812 06:27:16.113159 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:16.113197 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260812 06:27:16.178747 31220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:16.178534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:33811)
0812 06:27:16.178667 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:16.178704 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260812 06:27:16.294171 31223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:16.293973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:60335)
0812 06:27:16.294096 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:16.294132 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":60,"threads_started":1}
I20260812 06:27:16.793838 31225 raft_consensus.cc:482] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:27:16.793932 31225 raft_consensus.cc:504] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:27:16.794086 31225 leader_election.cc:288] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b795005794b84901a8c6007a6286c14d (127.30.15.67:34647), f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531)
W20260812 06:27:16.794490 30454 leader_election.cc:341] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b795005794b84901a8c6007a6286c14d (127.30.15.67:34647): Not found: Tablet not found: 5bfac7e8e6904715b2a626c2fc537941
W20260812 06:27:16.794580 30454 leader_election.cc:341] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531): Not found: Tablet not found: 5bfac7e8e6904715b2a626c2fc537941
I20260812 06:27:16.794603 30454 leader_election.cc:302] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b2954cd96ed47e388e89ff06609fa2d; no voters: b795005794b84901a8c6007a6286c14d, f285cf621cca4d7aa4b94bdb9e53ed15
I20260812 06:27:16.794667 31225 raft_consensus.cc:2726] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:27:17.113837 31231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:17.113605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:39919)
0812 06:27:17.113731 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:17.113767 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
I20260812 06:27:17.179440 31234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:17.179159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:40099)
0812 06:27:17.179343 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:17.179382 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":76,"threads_started":1}
I20260812 06:27:17.294816 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:17.294580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:44649)
0812 06:27:17.294705 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:17.294741 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":75,"threads_started":1}
I20260812 06:27:18.114535 31236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:18.114301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:56583)
0812 06:27:18.114441 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:18.114479 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":87,"threads_started":1}
I20260812 06:27:18.179979 31237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:18.179792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:44345)
0812 06:27:18.179901 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:18.179935 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":62,"threads_started":1}
I20260812 06:27:18.295413 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:18.295183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:47425)
0812 06:27:18.295324 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:18.295361 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":60,"threads_started":1}
I20260812 06:27:19.115235 31240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:19.115002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:42869)
0812 06:27:19.115144 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:19.115185 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
I20260812 06:27:19.180552 31245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:19.180345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:58499)
0812 06:27:19.180468 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:19.180508 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
I20260812 06:27:19.241496 31246 raft_consensus.cc:482] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:27:19.241600 31246 raft_consensus.cc:504] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:27:19.241739 31246 leader_election.cc:288] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b795005794b84901a8c6007a6286c14d (127.30.15.67:34647), f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531)
W20260812 06:27:19.242125 30454 leader_election.cc:341] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b795005794b84901a8c6007a6286c14d (127.30.15.67:34647): Not found: Tablet not found: 5bfac7e8e6904715b2a626c2fc537941
W20260812 06:27:19.242210 30454 leader_election.cc:341] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531): Not found: Tablet not found: 5bfac7e8e6904715b2a626c2fc537941
I20260812 06:27:19.242242 30454 leader_election.cc:302] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b2954cd96ed47e388e89ff06609fa2d; no voters: b795005794b84901a8c6007a6286c14d, f285cf621cca4d7aa4b94bdb9e53ed15
I20260812 06:27:19.242327 31246 raft_consensus.cc:2726] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:27:19.295977 31247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:19.295763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:38273)
0812 06:27:19.295895 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:19.295929 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":74,"threads_started":1}
I20260812 06:27:20.115896 31251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:20.115682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:58639)
0812 06:27:20.115807 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:20.115848 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260812 06:27:20.181092 31253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:20.180908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:60199)
0812 06:27:20.181019 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:20.181051 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":61,"threads_started":1}
I20260812 06:27:20.296515 31255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:20.296324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:46889)
0812 06:27:20.296440 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:20.296475 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":60,"threads_started":1}
I20260812 06:27:21.116643 31257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:21.116389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:36553)
0812 06:27:21.116551 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:21.116593 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":68,"threads_started":1}
I20260812 06:27:21.181651 31259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:21.181458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:38705)
0812 06:27:21.181572 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:21.181609 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260812 06:27:21.297108 31263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:21.296874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:46101)
0812 06:27:21.297028 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:21.297065 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":74,"threads_started":1}
I20260812 06:27:22.117290 31264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:22.117084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:60639)
0812 06:27:22.117204 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:22.117242 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":68,"threads_started":1}
I20260812 06:27:22.182243 31266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:22.182042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:46583)
0812 06:27:22.182168 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:22.182201 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":78,"threads_started":1}
I20260812 06:27:22.297699 31267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:22.297488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:51585)
0812 06:27:22.297622 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:22.297658 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":61,"threads_started":1}
I20260812 06:27:23.117920 31268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:23.117700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:49681)
0812 06:27:23.117827 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:23.117866 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":57,"threads_started":1}
I20260812 06:27:23.182853 31271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:23.182636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:39565)
0812 06:27:23.182781 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:23.182811 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":76,"threads_started":1}
I20260812 06:27:23.298331 31274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:23.298100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:38763)
0812 06:27:23.298253 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:23.298288 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":80,"threads_started":1}
I20260812 06:27:24.118556 31275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:24.118299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:33983)
0812 06:27:24.118464 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:24.118506 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":68,"threads_started":1}
I20260812 06:27:24.131171 31276 raft_consensus.cc:482] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:27:24.131290 31276 raft_consensus.cc:504] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b795005794b84901a8c6007a6286c14d" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 34647 } } peers { permanent_uuid: "f285cf621cca4d7aa4b94bdb9e53ed15" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 39531 } } peers { permanent_uuid: "7b2954cd96ed47e388e89ff06609fa2d" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33053 } }
I20260812 06:27:24.131436 31276 leader_election.cc:288] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b795005794b84901a8c6007a6286c14d (127.30.15.67:34647), f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531)
W20260812 06:27:24.131829 30454 leader_election.cc:341] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f285cf621cca4d7aa4b94bdb9e53ed15 (127.30.15.66:39531): Not found: Tablet not found: 5bfac7e8e6904715b2a626c2fc537941
W20260812 06:27:24.131887 30454 leader_election.cc:341] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b795005794b84901a8c6007a6286c14d (127.30.15.67:34647): Not found: Tablet not found: 5bfac7e8e6904715b2a626c2fc537941
I20260812 06:27:24.131902 30454 leader_election.cc:302] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b2954cd96ed47e388e89ff06609fa2d; no voters: b795005794b84901a8c6007a6286c14d, f285cf621cca4d7aa4b94bdb9e53ed15
I20260812 06:27:24.131987 31276 raft_consensus.cc:2726] T 5bfac7e8e6904715b2a626c2fc537941 P 7b2954cd96ed47e388e89ff06609fa2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 06:27:24.183499 31278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:24.183303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:51063)
0812 06:27:24.183423 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:24.183457 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":71,"threads_started":1}
I20260812 06:27:24.298890 31280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:24.298692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:39689)
0812 06:27:24.298818 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:24.298851 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
I20260812 06:27:25.119194 31281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:25.118962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:35937)
0812 06:27:25.119111 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:25.119146 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260812 06:27:25.184083 31283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:25.183872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:38285)
0812 06:27:25.183997 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:25.184033 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":57,"threads_started":1}
I20260812 06:27:25.299453 31284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:25.299240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:48323)
0812 06:27:25.299379 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:25.299412 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
I20260812 06:27:26.119856 31286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:26.119633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:39377)
0812 06:27:26.119762 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:26.119808 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":62,"threads_started":1}
I20260812 06:27:26.184707 31287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:26.184493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:56281)
0812 06:27:26.184628 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:26.184664 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260812 06:27:26.299995 31288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:26.299800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:44479)
0812 06:27:26.299922 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:26.299955 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":59,"threads_started":1}
I20260812 06:27:27.120540 31290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:27.120310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:34883)
0812 06:27:27.120454 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:27.120494 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
I20260812 06:27:27.185343 31291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:27.185122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:46253)
0812 06:27:27.185259 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:27.185295 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260812 06:27:27.300571 31292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:27.300352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:43869)
0812 06:27:27.300484 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:27.300523 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":59,"threads_started":1}
I20260812 06:27:28.121186 31295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:28.120987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.65:47183)
0812 06:27:28.121104 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:28.121137 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":58,"threads_started":1}
I20260812 06:27:28.186009 31296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:28.185801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.66:55815)
0812 06:27:28.185929 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:28.185967 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
I20260812 06:27:28.295960 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 30354
I20260812 06:27:28.305558 31297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:28.302883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41265 (local address 127.30.15.67:42109)
0812 06:27:28.305474 (+ 2591us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:28.305508 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.126:41265: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2572,"thread_start_us":54,"threads_started":1}
I20260812 06:27:28.309996 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 30686
I20260812 06:27:28.319379 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 30965
2026-08-12T06:27:28Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58604 ms)
[----------] 30 tests from SecurityITest (231783 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:28 dist-test-slave-gjrz krb5kdc[31302](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:28 dist-test-slave-gjrz krb5kdc[31302](info): set up 2 sockets
Aug 12 06:27:28 dist-test-slave-gjrz krb5kdc[31302](info): commencing operation
krb5kdc: starting...
W20260812 06:27:29.513760 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:29 dist-test-slave-gjrz krb5kdc[31302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:27:29.621675 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:45479
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:44933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:45479
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:29.700618 31322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:29.700800 31322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:29.700820 31322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:29.701930 31322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:29.701970 31322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:29.701983 31322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:29.702006 31322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:29.702029 31322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:29.703594 31322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:44933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:45479
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:45479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:29.703840 31322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:29.704093 31322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:29.710101 31331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:29.710100 31332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:29.712819 31334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:29.713279 31322 server_base.cc:1034] running on GCE node
I20260812 06:27:29.713498 31322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:29.713778 31322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:29.714939 31322 hybrid_clock.cc:648] HybridClock initialized: now 1786516049714918 us; error 39 us; skew 500 ppm
Aug 12 06:27:29 dist-test-slave-gjrz krb5kdc[31302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516049, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:29.717295 31322 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:27:29.717655 31322 webserver.cc:460] Webserver started at http://127.30.15.126:41979/ using document root <none> and password file <none>
I20260812 06:27:29.717836 31322 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:29.717875 31322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:29.717962 31322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:29.718889 31322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "1727173ca6944c83b5aa048289e80d9b"
format_stamp: "Formatted at 2026-08-12 06:27:29 on dist-test-slave-gjrz"
server_key: "81e6337211db03f63a6db24ccd478b82"
server_key_iv: "51cd2069805a9e866d8a4d8e0c38afea"
server_key_version: "encryptionkey@0"
I20260812 06:27:29.719178 31322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "1727173ca6944c83b5aa048289e80d9b"
format_stamp: "Formatted at 2026-08-12 06:27:29 on dist-test-slave-gjrz"
server_key: "81e6337211db03f63a6db24ccd478b82"
server_key_iv: "51cd2069805a9e866d8a4d8e0c38afea"
server_key_version: "encryptionkey@0"
I20260812 06:27:29.720363 31322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:27:29.720952 31350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:29.721110 31322 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:27:29.721192 31322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "1727173ca6944c83b5aa048289e80d9b"
format_stamp: "Formatted at 2026-08-12 06:27:29 on dist-test-slave-gjrz"
server_key: "81e6337211db03f63a6db24ccd478b82"
server_key_iv: "51cd2069805a9e866d8a4d8e0c38afea"
server_key_version: "encryptionkey@0"
I20260812 06:27:29.721246 31322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:29.739403 31322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:29.740988 31322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:29.741089 31322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:29.744810 31322 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:45479
I20260812 06:27:29.744845 31445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:45479 every 8 connection(s)
I20260812 06:27:29.745139 31322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:29.745929 31446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:29.746135 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 31322
I20260812 06:27:29.746227 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:29.746399 30781 external_mini_cluster.cc:1428] Setting key abcc19583bf129dc10479866e76da1a8
I20260812 06:27:29.748734 31446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b: Bootstrap starting.
I20260812 06:27:29.749405 31446 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:29.749707 31446 log.cc:824] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:29.750357 31446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b: No bootstrap required, opened a new log
I20260812 06:27:29.752384 31446 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1727173ca6944c83b5aa048289e80d9b" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45479 } }
I20260812 06:27:29.752514 31446 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:29.752556 31446 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1727173ca6944c83b5aa048289e80d9b, State: Initialized, Role: FOLLOWER
Aug 12 06:27:29 dist-test-slave-gjrz krb5kdc[31302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516049, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:29.752678 31446 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1727173ca6944c83b5aa048289e80d9b" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45479 } }
I20260812 06:27:29.752758 31446 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:29.752796 31446 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:29.752839 31446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:29.753423 31446 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1727173ca6944c83b5aa048289e80d9b" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45479 } }
I20260812 06:27:29.753512 31446 leader_election.cc:302] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1727173ca6944c83b5aa048289e80d9b; no voters:
I20260812 06:27:29.753662 31446 leader_election.cc:288] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:29.753700 31456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:29.753832 31456 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [term 1 LEADER]: Becoming Leader. State: Replica: 1727173ca6944c83b5aa048289e80d9b, State: Running, Role: LEADER
I20260812 06:27:29.753917 31446 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:29.753921 31456 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1727173ca6944c83b5aa048289e80d9b" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45479 } }
I20260812 06:27:29.754323 31460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1727173ca6944c83b5aa048289e80d9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1727173ca6944c83b5aa048289e80d9b" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45479 } } }
I20260812 06:27:29.754604 31460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:29.754526 31458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1727173ca6944c83b5aa048289e80d9b. Latest consensus state: current_term: 1 leader_uuid: "1727173ca6944c83b5aa048289e80d9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1727173ca6944c83b5aa048289e80d9b" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 45479 } } }
I20260812 06:27:29.754737 31458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:29.754992 31474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:29.755475 31474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:29.756912 31474 catalog_manager.cc:1347] Generated new cluster ID: 395c46a783e244588437f2027c41754e
I20260812 06:27:29.756964 31474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:29.757452 31452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:29.746834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53922 (local address 127.30.15.126:45479)
0812 06:27:29.747019 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:29.747040 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:29.747074 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:27:29.747596 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:29.747604 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:29.747664 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:29.747804 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:29.748362 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:29.749623 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:29.750357 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:29.750914 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:29.751039 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:29.753212 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:29.753216 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:29.753216 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:29.753226 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:29.755884 (+ 2658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:29.756246 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:29.756249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:29.756250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:29.756353 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:29.756552 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:29.756553 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:29.756553 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:29.756787 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:29.756916 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:29.757147 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 06:27:29.757276 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":87,"threads_started":1}
I20260812 06:27:29.770084 31474 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:29.770749 31474 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:29.780025 31474 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b: Generated new TSK 0
I20260812 06:27:29.780172 31474 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:27:29.809429 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45479
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:44933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:29.888057 31501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:29.888230 31501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:29.888252 31501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:29.889377 31501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:29.889424 31501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:29.889459 31501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:27:29.890923 31501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:44933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:29.891125 31501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:29.891345 31501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:29.895893 31511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:29.896023 31501 server_base.cc:1034] running on GCE node
W20260812 06:27:29.895903 31514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:29.895903 31509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:29.896312 31501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:29.896538 31501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:29.897680 31501 hybrid_clock.cc:648] HybridClock initialized: now 1786516049897664 us; error 27 us; skew 500 ppm
Aug 12 06:27:29 dist-test-slave-gjrz krb5kdc[31302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516049, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:29.899950 31501 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:27:29.900333 31501 webserver.cc:460] Webserver started at http://127.30.15.65:44963/ using document root <none> and password file <none>
I20260812 06:27:29.900513 31501 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:29.900558 31501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:29.900671 31501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:29.901605 31501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "503aa97c18cc43e1acfecfd8efb82470"
format_stamp: "Formatted at 2026-08-12 06:27:29 on dist-test-slave-gjrz"
server_key: "0aa124f592f7e9e045949f376e89f946"
server_key_iv: "1b21547003ecb8e2de999a7908fa7c4b"
server_key_version: "encryptionkey@0"
I20260812 06:27:29.901929 31501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "503aa97c18cc43e1acfecfd8efb82470"
format_stamp: "Formatted at 2026-08-12 06:27:29 on dist-test-slave-gjrz"
server_key: "0aa124f592f7e9e045949f376e89f946"
server_key_iv: "1b21547003ecb8e2de999a7908fa7c4b"
server_key_version: "encryptionkey@0"
I20260812 06:27:29.903115 31501 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:27:29.903811 31528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:29.903976 31501 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:29.904059 31501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "503aa97c18cc43e1acfecfd8efb82470"
format_stamp: "Formatted at 2026-08-12 06:27:29 on dist-test-slave-gjrz"
server_key: "0aa124f592f7e9e045949f376e89f946"
server_key_iv: "1b21547003ecb8e2de999a7908fa7c4b"
server_key_version: "encryptionkey@0"
I20260812 06:27:29.904126 31501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:29.919113 31501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:29.921042 31501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:29.921172 31501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:29.921377 31501 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:29.921639 31501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:29.921670 31501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:29.921689 31501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:29.921712 31501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:29.927459 31501 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:42657
I20260812 06:27:29.927528 31747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:42657 every 8 connection(s)
I20260812 06:27:29.927776 31501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:27:29 dist-test-slave-gjrz krb5kdc[31302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516049, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:29.933624 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 31501
I20260812 06:27:29.933728 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:27:29.933928 30781 external_mini_cluster.cc:1428] Setting key 208b0edfb8ddc3ca6fbeb51d44a3d36c
I20260812 06:27:29.936090 31452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:29.928373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:43547 (local address 127.30.15.126:45479)
0812 06:27:29.928439 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:29.928441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:29.928612 (+ 171us) server_negotiation.cc:407] Connection header received
0812 06:27:29.929039 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:29.929040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:29.929050 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:29.929097 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:29.929907 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:29.930395 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:29.931350 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:29.931556 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:29.931604 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:29.933488 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:29.933490 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:29.933490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:29.933496 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:29.934795 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:29.935217 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:29.935218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:29.935218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:29.935284 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:29.935526 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:29.935526 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:29.935526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:29.935621 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:29.935667 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:29.935960 (+ 293us) server_negotiation.cc:299] Negotiation successful
0812 06:27:29.936021 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:27:29.936296 31750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:29.928344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:45479 (local address 127.30.15.65:43547)
0812 06:27:29.928498 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:29.928531 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:29.928968 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:29.929149 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:29.929152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:29.929670 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:29.929844 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:29.929848 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:29.930452 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:29.930452 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:29.931220 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:29.931222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:29.931616 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:29.931617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:29.931718 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:29.932114 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:27:29.932122 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:29.933387 (+ 1265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:29.934867 (+ 1480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:29.934875 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:29.934877 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:29.935144 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:29.935340 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:29.935341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:29.935341 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:29.935472 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:29.935673 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:29.935679 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:29.935822 (+ 143us) client_negotiation.cc:769] Sending connection context
0812 06:27:29.935942 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 06:27:29.936093 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":79,"threads_started":1}
I20260812 06:27:29.936817 31748 heartbeater.cc:347] Connected to a master server at 127.30.15.126:45479
I20260812 06:27:29.936914 31748 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:29.937088 31748 heartbeater.cc:511] Master 127.30.15.126:45479 requested a full tablet report, sending...
I20260812 06:27:29.937582 31381 ts_manager.cc:194] Registered new tserver with Master: 503aa97c18cc43e1acfecfd8efb82470 (127.30.15.65:42657)
I20260812 06:27:29.938184 31381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:43547
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:27:29.958127 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45479
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:44933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:30.037410 31756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:30.037602 31756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:30.037624 31756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:30.038735 31756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:30.038774 31756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:30.038803 31756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:27:30.040241 31756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:44933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:30.040441 31756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:30.040637 31756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:30.045251 31773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:30.045235 31771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:30.045375 31756 server_base.cc:1034] running on GCE node
W20260812 06:27:30.045235 31776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:30.045619 31756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:30.045840 31756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:30.046972 31756 hybrid_clock.cc:648] HybridClock initialized: now 1786516050046959 us; error 26 us; skew 500 ppm
Aug 12 06:27:30 dist-test-slave-gjrz krb5kdc[31302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516050, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:30.049309 31756 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:27:30.049690 31756 webserver.cc:460] Webserver started at http://127.30.15.66:40863/ using document root <none> and password file <none>
I20260812 06:27:30.049872 31756 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:30.049918 31756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:30.050038 31756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:30.050987 31756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "0f439069398d44bf98da8b7f27df9a57"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "719c5a33f9058d58bfb7cc8adbc6cedb"
server_key_iv: "b76c3d2e8c3230c38eed6dc1354a856c"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.051347 31756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "0f439069398d44bf98da8b7f27df9a57"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "719c5a33f9058d58bfb7cc8adbc6cedb"
server_key_iv: "b76c3d2e8c3230c38eed6dc1354a856c"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.052577 31756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:27:30.053210 31790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.053344 31756 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:27:30.053424 31756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "0f439069398d44bf98da8b7f27df9a57"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "719c5a33f9058d58bfb7cc8adbc6cedb"
server_key_iv: "b76c3d2e8c3230c38eed6dc1354a856c"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.053488 31756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:30.063093 31756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:30.065045 31756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:30.065174 31756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:30.065371 31756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:30.065651 31756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:30.065685 31756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.065711 31756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:30.065729 31756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.071205 31756 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:37217
I20260812 06:27:30.071286 32003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:37217 every 8 connection(s)
I20260812 06:27:30.071552 31756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:27:30.072022 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 31756
I20260812 06:27:30.072151 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:27:30.072363 30781 external_mini_cluster.cc:1428] Setting key 5bb67019d32fa772959de6a0f1ece4f1
Aug 12 06:27:30 dist-test-slave-gjrz krb5kdc[31302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516050, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:30.080438 31452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.072183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:56813 (local address 127.30.15.126:45479)
0812 06:27:30.072226 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:30.072228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:30.072467 (+ 239us) server_negotiation.cc:407] Connection header received
0812 06:27:30.072982 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:30.072983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:30.072992 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:30.073056 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:30.073888 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.074553 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.075553 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.075747 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.075804 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.077675 (+ 1871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:30.077677 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:30.077677 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:30.077685 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:30.079109 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:30.079561 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:30.079563 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:30.079563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:30.079632 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:30.079835 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:30.079836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:30.079836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:30.079969 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:30.080040 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:30.080255 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 06:27:30.080346 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:27:30.080485 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.072172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:45479 (local address 127.30.15.66:56813)
0812 06:27:30.072354 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:30.072396 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:30.072888 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:30.073106 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:30.073109 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:30.073623 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:30.073795 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.073800 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.074628 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.074628 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.075468 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.075471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.075817 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.075818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.075932 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.076332 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:27:30.076340 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:30.077586 (+ 1246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:30.079203 (+ 1617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:30.079210 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:30.079212 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:30.079475 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:30.079691 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:30.079692 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:30.079692 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:30.079782 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:30.080028 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:30.080031 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:30.080137 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 06:27:30.080214 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 06:27:30.080327 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":88,"threads_started":1}
I20260812 06:27:30.080948 32005 heartbeater.cc:347] Connected to a master server at 127.30.15.126:45479
I20260812 06:27:30.081032 32005 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:30.081185 32005 heartbeater.cc:511] Master 127.30.15.126:45479 requested a full tablet report, sending...
I20260812 06:27:30.081538 31381 ts_manager.cc:194] Registered new tserver with Master: 0f439069398d44bf98da8b7f27df9a57 (127.30.15.66:37217)
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
I20260812 06:27:30.081924 31381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:56813
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:27:30.095949 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45479
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:44933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:30.176772 32012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:30.176949 32012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:30.176970 32012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:30.178035 32012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:30.178074 32012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:30.178099 32012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:27:30.179608 32012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:44933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:45479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:30.179801 32012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:30.179979 32012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:30.184657 32021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:30.184729 32012 server_base.cc:1034] running on GCE node
W20260812 06:27:30.184675 32025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:30.184675 32019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:30.185038 32012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:30.185281 32012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:30.186429 32012 hybrid_clock.cc:648] HybridClock initialized: now 1786516050186415 us; error 27 us; skew 500 ppm
Aug 12 06:27:30 dist-test-slave-gjrz krb5kdc[31302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516050, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:30.188799 32012 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:27:30.189186 32012 webserver.cc:460] Webserver started at http://127.30.15.67:40083/ using document root <none> and password file <none>
I20260812 06:27:30.189394 32012 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:30.189441 32012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:30.189565 32012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:30.190501 32012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "6d65bbe065174eee8ae342a68452433e"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "43411e22e43f1f482924da30f772b82a"
server_key_iv: "2db0b1f260e2ce9fb9a8641827345362"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.190829 32012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "6d65bbe065174eee8ae342a68452433e"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "43411e22e43f1f482924da30f772b82a"
server_key_iv: "2db0b1f260e2ce9fb9a8641827345362"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.192055 32012 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:27:30.192672 32037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.192811 32012 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:30.192889 32012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "6d65bbe065174eee8ae342a68452433e"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "43411e22e43f1f482924da30f772b82a"
server_key_iv: "2db0b1f260e2ce9fb9a8641827345362"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.192946 32012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:30.230209 32012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:30.232205 32012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:30.232337 32012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:30.232549 32012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:30.232827 32012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:30.232859 32012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.232887 32012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:30.232904 32012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.238368 32012 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:37587
I20260812 06:27:30.238431 32255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:37587 every 8 connection(s)
I20260812 06:27:30.238688 32012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:27:30.240386 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 32012
I20260812 06:27:30.240490 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:27:30.240669 30781 external_mini_cluster.cc:1428] Setting key 696b3408ce153562030ef01add589200
Aug 12 06:27:30 dist-test-slave-gjrz krb5kdc[31302](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516050, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:30.246892 31452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.239338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:59231 (local address 127.30.15.126:45479)
0812 06:27:30.239386 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:30.239388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:30.239570 (+ 182us) server_negotiation.cc:407] Connection header received
0812 06:27:30.240008 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:30.240009 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:30.240019 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:30.240076 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:30.241066 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.241718 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.242698 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.242899 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.242955 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.244887 (+ 1932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:30.244888 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:30.244888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:30.244894 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:30.245919 (+ 1025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:30.246244 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:30.246244 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:30.246244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:30.246287 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:30.246452 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:30.246452 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:30.246453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:30.246543 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:30.246588 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:30.246775 (+ 187us) server_negotiation.cc:299] Negotiation successful
0812 06:27:30.246831 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:27:30.247054 32265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.239311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:45479 (local address 127.30.15.67:59231)
0812 06:27:30.239457 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:30.239490 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:30.239937 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:30.240128 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:30.240131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:30.240700 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:30.240963 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.240970 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.241808 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.241808 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.242629 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.242631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.242960 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.242961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.243054 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.243505 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:27:30.243513 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:30.244811 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:30.245980 (+ 1169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:30.245986 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:30.245987 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:30.246189 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:30.246330 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:30.246330 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:30.246330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:30.246412 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:30.246585 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:30.246587 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:30.246687 (+ 100us) client_negotiation.cc:769] Sending connection context
0812 06:27:30.246759 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 06:27:30.246868 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260812 06:27:30.247603 32256 heartbeater.cc:347] Connected to a master server at 127.30.15.126:45479
I20260812 06:27:30.247691 32256 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:30.247855 32256 heartbeater.cc:511] Master 127.30.15.126:45479 requested a full tablet report, sending...
I20260812 06:27:30.248194 31381 ts_manager.cc:194] Registered new tserver with Master: 6d65bbe065174eee8ae342a68452433e (127.30.15.67:37587)
I20260812 06:27:30.248512 31381 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:59231
I20260812 06:27:30.252024 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:27:30.258376 31452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.253285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53926 (local address 127.30.15.126:45479)
0812 06:27:30.253357 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:30.253359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:30.253440 (+ 81us) server_negotiation.cc:407] Connection header received
0812 06:27:30.253486 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:30.253486 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:30.253494 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:30.253537 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:30.254092 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.254563 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.255330 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.255506 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.255558 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.256578 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:30.256579 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:30.256579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:30.256585 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:30.257597 (+ 1012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:30.257864 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:30.257865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:30.257865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:30.257905 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:30.258018 (+ 113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:30.258018 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:30.258018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:30.258136 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:30.258203 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:30.258272 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 06:27:30.258321 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 06:27:30.259624 31381 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53926:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:27:30.261063 31381 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:27:30.266608 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.263002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:37217 (local address 127.0.0.1:47630)
0812 06:27:30.263198 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:30.263208 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:30.263287 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:30.263484 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:30.263487 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:30.263489 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:30.263547 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.263549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.264487 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.264488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.265387 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.265389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.266315 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.266316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.266403 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.266416 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 06:27:30.266483 (+ 67us) client_negotiation.cc:240] Negotiation successful
0812 06:27:30.266539 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":41,"threads_started":1}
I20260812 06:27:30.266625 32282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.263130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47630 (local address 127.30.15.66:37217)
0812 06:27:30.263334 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:30.263337 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:30.263347 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:27:30.263387 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:30.263388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:30.263404 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:30.263475 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:30.263611 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.264404 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.265474 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.266245 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.266309 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.266364 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:30.266500 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 06:27:30.266541 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":73,"threads_started":1}
I20260812 06:27:30.267072 32278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.263122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:37587 (local address 127.0.0.1:46656)
0812 06:27:30.263479 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:30.263488 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:30.263567 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:30.263817 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:30.263817 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:30.263820 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:30.263878 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.263880 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.265110 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.265111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.266052 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.266054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.266840 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.266841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.266914 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.266918 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:30.266965 (+ 47us) client_negotiation.cc:240] Negotiation successful
0812 06:27:30.267002 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":44,"threads_started":1}
I20260812 06:27:30.267092 32285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.263282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46656 (local address 127.30.15.67:37587)
0812 06:27:30.263436 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:30.263440 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:30.263531 (+ 91us) server_negotiation.cc:407] Connection header received
0812 06:27:30.263666 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:30.263668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:30.263684 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:30.263752 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:30.263937 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.264998 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.266121 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.266772 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.266831 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.266883 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:30.266986 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 06:27:30.267021 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":71,"threads_started":1}
I20260812 06:27:30.267493 32276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.262824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:42657 (local address 127.0.0.1:56580)
0812 06:27:30.263138 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:30.263176 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:30.263301 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:30.263607 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:30.263608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:30.263610 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:30.263738 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.263740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.265084 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.265085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.266044 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.266057 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.267227 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.267228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.267331 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.267335 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:30.267391 (+ 56us) client_negotiation.cc:240] Negotiation successful
0812 06:27:30.267429 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":25,"thread_start_us":54,"threads_started":1}
I20260812 06:27:30.267524 32277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.262947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56580 (local address 127.30.15.65:42657)
0812 06:27:30.263119 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:30.263123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:30.263241 (+ 118us) server_negotiation.cc:407] Connection header received
0812 06:27:30.263421 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:30.263424 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:30.263440 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:30.263520 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:30.263823 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.264963 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.266159 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.266958 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.266999 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.267060 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:30.267408 (+ 348us) server_negotiation.cc:299] Negotiation successful
0812 06:27:30.267451 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":89,"threads_started":1}
I20260812 06:27:30.267567 31874 tablet_service.cc:1467] Processing CreateTablet for tablet 4bf56c4f3171442abb57df75e96a42c0 (DEFAULT_TABLE table=test-table [id=799d5041a7464edb93729da414339ab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:30.267722 32133 tablet_service.cc:1467] Processing CreateTablet for tablet 4bf56c4f3171442abb57df75e96a42c0 (DEFAULT_TABLE table=test-table [id=799d5041a7464edb93729da414339ab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:30.267920 31874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bf56c4f3171442abb57df75e96a42c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:30.268054 32133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bf56c4f3171442abb57df75e96a42c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:30.268278 31614 tablet_service.cc:1467] Processing CreateTablet for tablet 4bf56c4f3171442abb57df75e96a42c0 (DEFAULT_TABLE table=test-table [id=799d5041a7464edb93729da414339ab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:30.268602 31614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bf56c4f3171442abb57df75e96a42c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:30.270444 32286 tablet_bootstrap.cc:492] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57: Bootstrap starting.
I20260812 06:27:30.271085 32286 tablet_bootstrap.cc:654] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:30.271203 32287 tablet_bootstrap.cc:492] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e: Bootstrap starting.
I20260812 06:27:30.271790 32286 log.cc:824] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:30.271870 32287 tablet_bootstrap.cc:654] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:30.271934 32288 tablet_bootstrap.cc:492] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470: Bootstrap starting.
I20260812 06:27:30.272356 32287 log.cc:824] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:30.272578 32288 tablet_bootstrap.cc:654] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:30.272732 32286 tablet_bootstrap.cc:492] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57: No bootstrap required, opened a new log
I20260812 06:27:30.272804 32286 ts_tablet_manager.cc:1397] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:27:30.273031 32287 tablet_bootstrap.cc:492] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e: No bootstrap required, opened a new log
I20260812 06:27:30.273093 32287 ts_tablet_manager.cc:1397] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260812 06:27:30.273116 32288 log.cc:824] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:30.273862 32288 tablet_bootstrap.cc:492] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470: No bootstrap required, opened a new log
I20260812 06:27:30.273931 32288 ts_tablet_manager.cc:1397] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:27:30.274586 32287 raft_consensus.cc:348] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503aa97c18cc43e1acfecfd8efb82470" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42657 } } peers { permanent_uuid: "0f439069398d44bf98da8b7f27df9a57" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 37217 } } peers { permanent_uuid: "6d65bbe065174eee8ae342a68452433e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 37587 } }
I20260812 06:27:30.274722 32287 raft_consensus.cc:374] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:30.274755 32287 raft_consensus.cc:729] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d65bbe065174eee8ae342a68452433e, State: Initialized, Role: FOLLOWER
I20260812 06:27:30.274912 32287 consensus_queue.cc:260] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503aa97c18cc43e1acfecfd8efb82470" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42657 } } peers { permanent_uuid: "0f439069398d44bf98da8b7f27df9a57" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 37217 } } peers { permanent_uuid: "6d65bbe065174eee8ae342a68452433e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 37587 } }
I20260812 06:27:30.275017 32286 raft_consensus.cc:348] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503aa97c18cc43e1acfecfd8efb82470" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42657 } } peers { permanent_uuid: "0f439069398d44bf98da8b7f27df9a57" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 37217 } } peers { permanent_uuid: "6d65bbe065174eee8ae342a68452433e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 37587 } }
I20260812 06:27:30.275166 32287 ts_tablet_manager.cc:1428] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:27:30.275213 32286 raft_consensus.cc:374] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:30.275255 32286 raft_consensus.cc:729] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f439069398d44bf98da8b7f27df9a57, State: Initialized, Role: FOLLOWER
I20260812 06:27:30.275298 32256 heartbeater.cc:503] Master 127.30.15.126:45479 was elected leader, sending a full tablet report...
I20260812 06:27:30.275390 32286 consensus_queue.cc:260] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503aa97c18cc43e1acfecfd8efb82470" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42657 } } peers { permanent_uuid: "0f439069398d44bf98da8b7f27df9a57" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 37217 } } peers { permanent_uuid: "6d65bbe065174eee8ae342a68452433e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 37587 } }
I20260812 06:27:30.275661 32286 ts_tablet_manager.cc:1428] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:27:30.275678 32005 heartbeater.cc:503] Master 127.30.15.126:45479 was elected leader, sending a full tablet report...
I20260812 06:27:30.275840 32288 raft_consensus.cc:348] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503aa97c18cc43e1acfecfd8efb82470" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42657 } } peers { permanent_uuid: "0f439069398d44bf98da8b7f27df9a57" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 37217 } } peers { permanent_uuid: "6d65bbe065174eee8ae342a68452433e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 37587 } }
I20260812 06:27:30.275993 32288 raft_consensus.cc:374] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:30.276032 32288 raft_consensus.cc:729] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 503aa97c18cc43e1acfecfd8efb82470, State: Initialized, Role: FOLLOWER
I20260812 06:27:30.276126 32288 consensus_queue.cc:260] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503aa97c18cc43e1acfecfd8efb82470" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42657 } } peers { permanent_uuid: "0f439069398d44bf98da8b7f27df9a57" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 37217 } } peers { permanent_uuid: "6d65bbe065174eee8ae342a68452433e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 37587 } }
I20260812 06:27:30.276388 32288 ts_tablet_manager.cc:1428] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 06:27:30.276401 31748 heartbeater.cc:503] Master 127.30.15.126:45479 was elected leader, sending a full tablet report...
W20260812 06:27:30.322098 32006 tablet.cc:2369] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:27:30.428440 31749 tablet.cc:2369] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:27:30.466820 32301 raft_consensus.cc:482] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:27:30.466953 32301 raft_consensus.cc:504] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503aa97c18cc43e1acfecfd8efb82470" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42657 } } peers { permanent_uuid: "0f439069398d44bf98da8b7f27df9a57" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 37217 } } peers { permanent_uuid: "6d65bbe065174eee8ae342a68452433e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 37587 } }
I20260812 06:27:30.467322 32301 leader_election.cc:288] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f439069398d44bf98da8b7f27df9a57 (127.30.15.66:37217), 6d65bbe065174eee8ae342a68452433e (127.30.15.67:37587)
I20260812 06:27:30.470148 32285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.467782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:48343 (local address 127.30.15.67:37587)
0812 06:27:30.467823 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:30.467824 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:30.467832 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:27:30.467888 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:30.467889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:30.467895 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:30.467933 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:30.468072 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.468542 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.469453 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.469845 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.469908 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.469917 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:30.470040 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 06:27:30.470079 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:27:30.470182 32304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.467675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:37587 (local address 127.30.15.65:48343)
0812 06:27:30.467774 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:30.467784 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:30.467836 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:30.467938 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:30.467939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:30.467941 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:30.468005 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.468007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.468624 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.468625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.469376 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.469378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.469918 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.469919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.469981 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.469985 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:30.470029 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:27:30.470076 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":58,"threads_started":1}
I20260812 06:27:30.470220 32282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.467590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:34465 (local address 127.30.15.66:37217)
0812 06:27:30.467645 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:30.467647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:30.467685 (+ 38us) server_negotiation.cc:407] Connection header received
0812 06:27:30.467817 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:30.467819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:30.467831 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:30.467885 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:30.468148 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.468620 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.469512 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.469915 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.469979 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.469987 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:30.470121 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 06:27:30.470158 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:27:30.470427 32302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.467487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:37217 (local address 127.30.15.65:34465)
0812 06:27:30.467619 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:30.467632 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:30.467705 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:30.467976 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:30.467977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:30.467979 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:30.468081 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.468083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.468688 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.468690 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.469435 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.469437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.469984 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.469985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.470061 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.470065 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:30.470109 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:27:30.470148 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":9,"thread_start_us":76,"threads_started":1}
I20260812 06:27:30.470525 32166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf56c4f3171442abb57df75e96a42c0" candidate_uuid: "503aa97c18cc43e1acfecfd8efb82470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65bbe065174eee8ae342a68452433e" is_pre_election: true
I20260812 06:27:30.470674 32166 raft_consensus.cc:2454] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503aa97c18cc43e1acfecfd8efb82470 in term 0.
I20260812 06:27:30.470810 31919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf56c4f3171442abb57df75e96a42c0" candidate_uuid: "503aa97c18cc43e1acfecfd8efb82470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f439069398d44bf98da8b7f27df9a57" is_pre_election: true
I20260812 06:27:30.470892 31533 leader_election.cc:302] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 503aa97c18cc43e1acfecfd8efb82470, 6d65bbe065174eee8ae342a68452433e; no voters:
I20260812 06:27:30.470955 31919 raft_consensus.cc:2454] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 503aa97c18cc43e1acfecfd8efb82470 in term 0.
I20260812 06:27:30.471010 32301 raft_consensus.cc:2781] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:27:30.471089 32301 raft_consensus.cc:482] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:27:30.471117 32301 raft_consensus.cc:3037] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:30.471876 32301 raft_consensus.cc:504] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503aa97c18cc43e1acfecfd8efb82470" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42657 } } peers { permanent_uuid: "0f439069398d44bf98da8b7f27df9a57" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 37217 } } peers { permanent_uuid: "6d65bbe065174eee8ae342a68452433e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 37587 } }
I20260812 06:27:30.471985 32301 leader_election.cc:288] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [CANDIDATE]: Term 1 election: Requested vote from peers 0f439069398d44bf98da8b7f27df9a57 (127.30.15.66:37217), 6d65bbe065174eee8ae342a68452433e (127.30.15.67:37587)
I20260812 06:27:30.472136 31919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf56c4f3171442abb57df75e96a42c0" candidate_uuid: "503aa97c18cc43e1acfecfd8efb82470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f439069398d44bf98da8b7f27df9a57"
I20260812 06:27:30.472158 32166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bf56c4f3171442abb57df75e96a42c0" candidate_uuid: "503aa97c18cc43e1acfecfd8efb82470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d65bbe065174eee8ae342a68452433e"
I20260812 06:27:30.472204 31919 raft_consensus.cc:3037] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:30.472237 32166 raft_consensus.cc:3037] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:30.472893 31919 raft_consensus.cc:2454] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503aa97c18cc43e1acfecfd8efb82470 in term 1.
I20260812 06:27:30.472997 32166 raft_consensus.cc:2454] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 503aa97c18cc43e1acfecfd8efb82470 in term 1.
I20260812 06:27:30.473054 31533 leader_election.cc:302] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f439069398d44bf98da8b7f27df9a57, 503aa97c18cc43e1acfecfd8efb82470; no voters:
I20260812 06:27:30.473136 32301 raft_consensus.cc:2781] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:30.473296 32301 raft_consensus.cc:686] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 1 LEADER]: Becoming Leader. State: Replica: 503aa97c18cc43e1acfecfd8efb82470, State: Running, Role: LEADER
I20260812 06:27:30.473383 32301 consensus_queue.cc:237] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503aa97c18cc43e1acfecfd8efb82470" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42657 } } peers { permanent_uuid: "0f439069398d44bf98da8b7f27df9a57" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 37217 } } peers { permanent_uuid: "6d65bbe065174eee8ae342a68452433e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 37587 } }
I20260812 06:27:30.474150 31381 catalog_manager.cc:5495] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 reported cstate change: term changed from 0 to 1, leader changed from <none> to 503aa97c18cc43e1acfecfd8efb82470 (127.30.15.65). New cstate: current_term: 1 leader_uuid: "503aa97c18cc43e1acfecfd8efb82470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "503aa97c18cc43e1acfecfd8efb82470" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 42657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f439069398d44bf98da8b7f27df9a57" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 37217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d65bbe065174eee8ae342a68452433e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 37587 } health_report { overall_health: UNKNOWN } } }
W20260812 06:27:30.489195 32258 tablet.cc:2369] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:27:30.492401 32277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.490347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56590 (local address 127.30.15.65:42657)
0812 06:27:30.490399 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:30.490401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:30.490408 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:27:30.490447 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:30.490448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:30.490464 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:30.490517 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:27:30.490649 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.491109 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.491836 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.492018 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.492066 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.492184 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:27:30.492269 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:27:30.492320 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:30.492333 (+ 13us) server_negotiation.cc:299] Negotiation successful
0812 06:27:30.492347 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:27:30.493968 31919 raft_consensus.cc:1261] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57 [term 1 FOLLOWER]: Refusing update from remote peer 503aa97c18cc43e1acfecfd8efb82470: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:27:30.493968 32166 raft_consensus.cc:1261] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e [term 1 FOLLOWER]: Refusing update from remote peer 503aa97c18cc43e1acfecfd8efb82470: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:27:30.494280 32306 consensus_queue.cc:1035] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f439069398d44bf98da8b7f27df9a57" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 37217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:27:30.494402 32301 consensus_queue.cc:1035] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d65bbe065174eee8ae342a68452433e" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 37587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:27:30.496551 32310 mvcc.cc:205] Tried to move back new op lower bound from 7317569742820995072 to 7317569742739599360. Current Snapshot: MvccSnapshot[applied={T|T < 7317569742820995072}]
I20260812 06:27:30.497622 32313 mvcc.cc:205] Tried to move back new op lower bound from 7317569742820995072 to 7317569742739599360. Current Snapshot: MvccSnapshot[applied={T|T < 7317569742820995072}]
I20260812 06:27:30.498904 31381 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:27:30.498983 31381 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53926:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:27:30.499656 31381 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1727173ca6944c83b5aa048289e80d9b: Sending DeleteTablet for 3 replicas of tablet 4bf56c4f3171442abb57df75e96a42c0
I20260812 06:27:30.499931 31614 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bf56c4f3171442abb57df75e96a42c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:30 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:56580
I20260812 06:27:30.499976 31874 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bf56c4f3171442abb57df75e96a42c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:30 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:47630
I20260812 06:27:30.500005 32133 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bf56c4f3171442abb57df75e96a42c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:30 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:46656
I20260812 06:27:30.500209 32331 tablet_replica.cc:330] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470: stopping tablet replica
I20260812 06:27:30.500311 32331 raft_consensus.cc:2229] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:27:30.500399 32331 raft_consensus.cc:2258] T 4bf56c4f3171442abb57df75e96a42c0 P 503aa97c18cc43e1acfecfd8efb82470 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:30.500443 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 31501
I20260812 06:27:30.500533 32333 tablet_replica.cc:330] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e: stopping tablet replica
I20260812 06:27:30.500612 32333 raft_consensus.cc:2229] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:27:30.500692 32333 raft_consensus.cc:2258] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:30.512651 32332 tablet_replica.cc:330] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57: stopping tablet replica
I20260812 06:27:30.512801 32332 raft_consensus.cc:2229] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:27:30.512921 32332 raft_consensus.cc:2258] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:30.514029 32332 ts_tablet_manager.cc:1905] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:27:30.514525 32333 ts_tablet_manager.cc:1905] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:27:30.515674 32332 ts_tablet_manager.cc:1918] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:27:30.515754 32332 log.cc:1196] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/4bf56c4f3171442abb57df75e96a42c0
I20260812 06:27:30.516034 32332 ts_tablet_manager.cc:1939] T 4bf56c4f3171442abb57df75e96a42c0 P 0f439069398d44bf98da8b7f27df9a57: Deleting consensus metadata
I20260812 06:27:30.516201 32333 ts_tablet_manager.cc:1918] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:27:30.516273 32333 log.cc:1196] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/4bf56c4f3171442abb57df75e96a42c0
I20260812 06:27:30.516501 31353 catalog_manager.cc:4841] TS 0f439069398d44bf98da8b7f27df9a57 (127.30.15.66:37217): tablet 4bf56c4f3171442abb57df75e96a42c0 (table test-table [id=799d5041a7464edb93729da414339ab2]) successfully deleted
I20260812 06:27:30.516537 32333 ts_tablet_manager.cc:1939] T 4bf56c4f3171442abb57df75e96a42c0 P 6d65bbe065174eee8ae342a68452433e: Deleting consensus metadata
I20260812 06:27:30.516888 31353 catalog_manager.cc:4841] TS 6d65bbe065174eee8ae342a68452433e (127.30.15.67:37587): tablet 4bf56c4f3171442abb57df75e96a42c0 (table test-table [id=799d5041a7464edb93729da414339ab2]) successfully deleted
W20260812 06:27:30.518505 31353 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:42657 (error 108)
I20260812 06:27:30.518970 32276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.518860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:42657 (local address 127.0.0.1:56606)
0812 06:27:30.518907 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:30.518942 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:42657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:27:30.519070 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 31756
W20260812 06:27:30.519109 31353 catalog_manager.cc:4584] TS 503aa97c18cc43e1acfecfd8efb82470 (127.30.15.65:42657): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4bf56c4f3171442abb57df75e96a42c0: Network error: Client connection negotiation failed: client connection to 127.30.15.65:42657: connect: Connection refused (error 111)
I20260812 06:27:30.528553 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 32012
I20260812 06:27:30.536893 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 31322
2026-08-12T06:27:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2220 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T06:27:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:30Z Disabled control of system clock
I20260812 06:27:30.571875 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:34435
--webserver_interface=127.30.15.126
--webserver_port=0
--builtin_ntp_servers=127.30.15.84:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:34435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:27:30.650054 32342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:30.650242 32342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:30.650260 32342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:30.651321 32342 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:30.651353 32342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:30.651364 32342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:30.651376 32342 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:30.651391 32342 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:30.652648 32342 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:34435
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:34435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:30.652823 32342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:30.653045 32342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:30.657567 32350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:30.657572 32353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:30.657684 32342 server_base.cc:1034] running on GCE node
W20260812 06:27:30.657773 32349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:30.658011 32342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:30.658273 32342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:30.659406 32342 hybrid_clock.cc:648] HybridClock initialized: now 1786516050659390 us; error 32 us; skew 500 ppm
I20260812 06:27:30.660491 32342 webserver.cc:460] Webserver started at http://127.30.15.126:40265/ using document root <none> and password file <none>
I20260812 06:27:30.660717 32342 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:30.660761 32342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:30.660882 32342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:30.661823 32342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "e6241e1975d94424b56660f70a96508a"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "6dde76bfee9d96f06895d3541d6ea2eb"
server_key_iv: "5eeb73ecde9af4bba759444460bd06ee"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.662153 32342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "e6241e1975d94424b56660f70a96508a"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "6dde76bfee9d96f06895d3541d6ea2eb"
server_key_iv: "5eeb73ecde9af4bba759444460bd06ee"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.663327 32342 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:27:30.664024 32368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.664163 32342 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:30.664242 32342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "e6241e1975d94424b56660f70a96508a"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "6dde76bfee9d96f06895d3541d6ea2eb"
server_key_iv: "5eeb73ecde9af4bba759444460bd06ee"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.664309 32342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:30.675091 32342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:30.675343 32342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:30.675462 32342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:30.678942 32342 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:34435
I20260812 06:27:30.678988 32457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:34435 every 8 connection(s)
I20260812 06:27:30.679251 32342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:30.680181 32458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:30.682281 32458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a: Bootstrap starting.
I20260812 06:27:30.682812 32458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:30.683084 32458 log.cc:824] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:30.683710 32458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a: No bootstrap required, opened a new log
I20260812 06:27:30.685202 32458 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6241e1975d94424b56660f70a96508a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34435 } }
I20260812 06:27:30.685325 32458 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:30.685356 32458 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6241e1975d94424b56660f70a96508a, State: Initialized, Role: FOLLOWER
I20260812 06:27:30.685505 32458 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6241e1975d94424b56660f70a96508a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34435 } }
I20260812 06:27:30.685586 32458 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:30.685609 32458 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:30.685626 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 32342
I20260812 06:27:30.685654 32458 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:30.685722 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:30.685895 30781 external_mini_cluster.cc:1428] Setting key 47f45c95c4b7bcda42bff97e374488c1
I20260812 06:27:30.686187 32458 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6241e1975d94424b56660f70a96508a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34435 } }
I20260812 06:27:30.686288 32458 leader_election.cc:302] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6241e1975d94424b56660f70a96508a; no voters:
I20260812 06:27:30.686452 32458 leader_election.cc:288] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:30.686519 32464 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:30.686630 32464 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [term 1 LEADER]: Becoming Leader. State: Replica: e6241e1975d94424b56660f70a96508a, State: Running, Role: LEADER
I20260812 06:27:30.686704 32458 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:30.686704 32464 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6241e1975d94424b56660f70a96508a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34435 } }
I20260812 06:27:30.687141 32465 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6241e1975d94424b56660f70a96508a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6241e1975d94424b56660f70a96508a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34435 } } }
I20260812 06:27:30.687227 32465 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:30.687405 32466 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6241e1975d94424b56660f70a96508a. Latest consensus state: current_term: 1 leader_uuid: "e6241e1975d94424b56660f70a96508a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6241e1975d94424b56660f70a96508a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34435 } } }
I20260812 06:27:30.687467 32466 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:30.687575 32474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:30.688041 32474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:30.689545 32474 catalog_manager.cc:1347] Generated new cluster ID: 78f324140de9449382d4017d1d4f02be
I20260812 06:27:30.689597 32474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:30.691707 32463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.686323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40122 (local address 127.30.15.126:34435)
0812 06:27:30.686568 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:30.686576 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:30.686627 (+ 51us) server_negotiation.cc:407] Connection header received
0812 06:27:30.686758 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:30.686765 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:30.686871 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:30.686996 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:30.687239 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.688699 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.689722 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.690310 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.690426 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.691045 (+ 619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:30.691048 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:30.691049 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:30.691230 (+ 181us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:30.691286 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:30.691300 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:30.691354 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:30.691430 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 06:27:30.691499 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":98,"threads_started":1}
I20260812 06:27:30.701097 32474 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:30.701557 32474 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:30.711020 32474 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a: Generated new TSK 0
I20260812 06:27:30.711161 32474 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:30.714234 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34435
--builtin_ntp_servers=127.30.15.84:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:27:30.794174 32518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:30.794359 32518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:30.794379 32518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:30.795495 32518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:30.795531 32518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:30.795554 32518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:27:30.796844 32518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:30.797050 32518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:30.797309 32518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:30.802842 32530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:30.802836 32529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:30.803018 32518 server_base.cc:1034] running on GCE node
W20260812 06:27:30.803164 32532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:30.803359 32518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:30.803574 32518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:30.804709 32518 hybrid_clock.cc:648] HybridClock initialized: now 1786516050804696 us; error 29 us; skew 500 ppm
I20260812 06:27:30.805842 32518 webserver.cc:460] Webserver started at http://127.30.15.65:42089/ using document root <none> and password file <none>
I20260812 06:27:30.806057 32518 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:30.806103 32518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:30.806224 32518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:30.807185 32518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "604ab76e7fd3fa71aea84bb769969c7f"
server_key_iv: "80551fe96f6041c426fa6bbd9438ac23"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.807564 32518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "604ab76e7fd3fa71aea84bb769969c7f"
server_key_iv: "80551fe96f6041c426fa6bbd9438ac23"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.808724 32518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:27:30.809350 32540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.809506 32518 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:30.809588 32518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "604ab76e7fd3fa71aea84bb769969c7f"
server_key_iv: "80551fe96f6041c426fa6bbd9438ac23"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.809654 32518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:30.827121 32518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:30.827387 32518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:30.827508 32518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:30.827700 32518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:30.827986 32518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:30.828018 32518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.828052 32518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:30.828074 32518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.833539 32518 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:38009
I20260812 06:27:30.833600 32746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:38009 every 8 connection(s)
I20260812 06:27:30.833853 32518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:27:30.838258 32463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.834461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:33505 (local address 127.30.15.126:34435)
0812 06:27:30.834512 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:30.834514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:30.834746 (+ 232us) server_negotiation.cc:407] Connection header received
0812 06:27:30.835163 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:30.835164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:30.835175 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:30.835221 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:30.835845 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.836331 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.837204 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.837382 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.837422 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.838079 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:30.838080 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:30.838080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:30.838084 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:30.838094 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:30.838097 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:30.838125 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:30.838183 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 06:27:30.838204 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260812 06:27:30.838435 32762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.834448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:34435 (local address 127.30.15.65:33505)
0812 06:27:30.834641 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:30.834671 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:30.835092 (+ 421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:30.835289 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:30.835293 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:30.835303 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:30.835782 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.835786 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.836389 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.836390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.837144 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.837147 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.837431 (+ 284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.837431 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.837526 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.837971 (+ 445us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:27:30.837971 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:30.837997 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:27:30.838018 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:30.838133 (+ 115us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:30.838136 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:30.838138 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:27:30.838178 (+ 40us) client_negotiation.cc:240] Negotiation successful
0812 06:27:30.838250 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
I20260812 06:27:30.838889 32748 heartbeater.cc:347] Connected to a master server at 127.30.15.126:34435
I20260812 06:27:30.838969 32748 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:30.839108 32748 heartbeater.cc:511] Master 127.30.15.126:34435 requested a full tablet report, sending...
I20260812 06:27:30.839535 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 32518
I20260812 06:27:30.839622 32397 ts_manager.cc:194] Registered new tserver with Master: eb7ff5f2e7f24771b8cebd5d45ed86c0 (127.30.15.65:38009)
I20260812 06:27:30.839645 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:27:30.839847 30781 external_mini_cluster.cc:1428] Setting key 4a609d4455f9d05b8482619d43bcb655
I20260812 06:27:30.840312 32397 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.15.65:33505
I20260812 06:27:30.840829 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34435
--builtin_ntp_servers=127.30.15.84:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:27:30.921193 32763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:30.921392 32763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:30.921425 32763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:30.922631 32763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:30.922670 32763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:30.922703 32763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:27:30.924074 32763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:30.924289 32763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:30.924547 32763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:30.929235 307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:30.929234 312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:30.929350 32763 server_base.cc:1034] running on GCE node
W20260812 06:27:30.929256 308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:30.929687 32763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:30.929924 32763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:30.931082 32763 hybrid_clock.cc:648] HybridClock initialized: now 1786516050931070 us; error 26 us; skew 500 ppm
I20260812 06:27:30.932277 32763 webserver.cc:460] Webserver started at http://127.30.15.66:45233/ using document root <none> and password file <none>
I20260812 06:27:30.932485 32763 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:30.932559 32763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:30.932703 32763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:30.933687 32763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "9a6362f27e144ee5b228f1e93a58ed62"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "8d4957a6c40379382af072a19e1ccba1"
server_key_iv: "5e900f8372edf15c80ea1b4ccbf97634"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.934017 32763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "9a6362f27e144ee5b228f1e93a58ed62"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "8d4957a6c40379382af072a19e1ccba1"
server_key_iv: "5e900f8372edf15c80ea1b4ccbf97634"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.935221 32763 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:27:30.935964 327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.936121 32763 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:27:30.936203 32763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "9a6362f27e144ee5b228f1e93a58ed62"
format_stamp: "Formatted at 2026-08-12 06:27:30 on dist-test-slave-gjrz"
server_key: "8d4957a6c40379382af072a19e1ccba1"
server_key_iv: "5e900f8372edf15c80ea1b4ccbf97634"
server_key_version: "encryptionkey@0"
I20260812 06:27:30.936269 32763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:30.947131 32763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:30.947403 32763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:30.947523 32763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:30.947729 32763 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:30.948022 32763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:30.948057 32763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.948083 32763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:30.948101 32763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:30.953559 32763 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:42949
I20260812 06:27:30.953612 519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:42949 every 8 connection(s)
I20260812 06:27:30.953886 32763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:27:30.955883 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 32763
I20260812 06:27:30.955989 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:27:30.956209 30781 external_mini_cluster.cc:1428] Setting key a7637d8cee29531200da588bb436e18b
I20260812 06:27:30.957088 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34435
--builtin_ntp_servers=127.30.15.84:41523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:27:30.958874 32463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.954483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:42535 (local address 127.30.15.126:34435)
0812 06:27:30.954547 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:30.954549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:30.954768 (+ 219us) server_negotiation.cc:407] Connection header received
0812 06:27:30.955206 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:30.955207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:30.955217 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:30.955290 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:30.955906 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.956579 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.957617 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.957826 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.957881 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.958619 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:30.958620 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:30.958620 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:30.958625 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:30.958641 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:30.958645 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:30.958690 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:30.958765 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 06:27:30.958796 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:27:30.959048 524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:30.954457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:34435 (local address 127.30.15.66:42535)
0812 06:27:30.954652 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:30.954694 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:30.955118 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:30.955357 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:30.955361 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:30.955369 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:30.955827 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.955832 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.956660 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.956661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.957540 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:30.957543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:30.957895 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:30.957896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:30.958018 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:30.958492 (+ 474us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:27:30.958492 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:30.958519 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:27:30.958540 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:30.958696 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:30.958701 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:30.958704 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:27:30.958762 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:27:30.958858 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":102,"threads_started":1}
I20260812 06:27:30.959545 520 heartbeater.cc:347] Connected to a master server at 127.30.15.126:34435
I20260812 06:27:30.959630 520 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:30.959795 520 heartbeater.cc:511] Master 127.30.15.126:34435 requested a full tablet report, sending...
I20260812 06:27:30.960158 32397 ts_manager.cc:194] Registered new tserver with Master: 9a6362f27e144ee5b228f1e93a58ed62 (127.30.15.66:42949)
I20260812 06:27:30.960600 32397 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.15.66:42535
W20260812 06:27:31.037788 525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:31.037964 525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:31.037985 525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:31.039163 525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:31.039211 525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:31.039242 525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:27:31.040895 525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34435
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:31.041115 525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:31.041424 525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:31.046124 540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:31.046121 525 server_base.cc:1034] running on GCE node
W20260812 06:27:31.046106 536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:31.046097 547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:31.046545 525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:31.046766 525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:31.047899 525 hybrid_clock.cc:648] HybridClock initialized: now 1786516051047887 us; error 28 us; skew 500 ppm
I20260812 06:27:31.049049 525 webserver.cc:460] Webserver started at http://127.30.15.67:45939/ using document root <none> and password file <none>
I20260812 06:27:31.049268 525 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:31.049317 525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:31.049439 525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:31.050405 525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "0c5353697319421b95cd1ef84c7cbe84"
format_stamp: "Formatted at 2026-08-12 06:27:31 on dist-test-slave-gjrz"
server_key: "5ae4705e7ae681ae6902f70bc88ade19"
server_key_iv: "a321fbfcfc3d0170366c3754a928042f"
server_key_version: "encryptionkey@0"
I20260812 06:27:31.050719 525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "0c5353697319421b95cd1ef84c7cbe84"
format_stamp: "Formatted at 2026-08-12 06:27:31 on dist-test-slave-gjrz"
server_key: "5ae4705e7ae681ae6902f70bc88ade19"
server_key_iv: "a321fbfcfc3d0170366c3754a928042f"
server_key_version: "encryptionkey@0"
I20260812 06:27:31.051905 525 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:27:31.052564 558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:31.052708 525 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:27:31.052788 525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "0c5353697319421b95cd1ef84c7cbe84"
format_stamp: "Formatted at 2026-08-12 06:27:31 on dist-test-slave-gjrz"
server_key: "5ae4705e7ae681ae6902f70bc88ade19"
server_key_iv: "a321fbfcfc3d0170366c3754a928042f"
server_key_version: "encryptionkey@0"
I20260812 06:27:31.052846 525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:31.072440 525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:31.072700 525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:31.072820 525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:31.073030 525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:31.073318 525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:31.073349 525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:31.073376 525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:31.073393 525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:31.078904 525 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:43355
I20260812 06:27:31.078970 777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:43355 every 8 connection(s)
I20260812 06:27:31.079243 525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:27:31.082907 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 525
I20260812 06:27:31.083009 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:27:31.083201 30781 external_mini_cluster.cc:1428] Setting key 70ce5a7450ccab844328dd21e2a0f433
I20260812 06:27:31.084347 32463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.079914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:53281 (local address 127.30.15.126:34435)
0812 06:27:31.079966 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:31.079968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:31.080172 (+ 204us) server_negotiation.cc:407] Connection header received
0812 06:27:31.080684 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:31.080685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:31.080698 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:31.080749 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:31.081381 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.081891 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.082932 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.083143 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.083201 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.084107 (+ 906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:31.084108 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:31.084108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:31.084112 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:31.084127 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:31.084130 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:31.084163 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:31.084231 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 06:27:31.084264 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:27:31.084481 783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.079890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:34435 (local address 127.30.15.67:53281)
0812 06:27:31.080068 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:31.080098 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:31.080591 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:31.080815 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:31.080819 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:31.080829 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:31.081299 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:31.081304 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.081971 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.081972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:31.082837 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:31.082840 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.083232 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.083233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:31.083408 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.083938 (+ 530us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:27:31.083939 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:31.083975 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:27:31.084001 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:31.084168 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:31.084174 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:31.084176 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:27:31.084228 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 06:27:31.084307 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260812 06:27:31.084962 778 heartbeater.cc:347] Connected to a master server at 127.30.15.126:34435
I20260812 06:27:31.085039 778 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:31.085189 778 heartbeater.cc:511] Master 127.30.15.126:34435 requested a full tablet report, sending...
I20260812 06:27:31.085486 32397 ts_manager.cc:194] Registered new tserver with Master: 0c5353697319421b95cd1ef84c7cbe84 (127.30.15.67:43355)
I20260812 06:27:31.085829 32397 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.15.67:53281
I20260812 06:27:31.094795 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:27:31.098541 32463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.096063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40128 (local address 127.30.15.126:34435)
0812 06:27:31.096109 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:31.096111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:31.096208 (+ 97us) server_negotiation.cc:407] Connection header received
0812 06:27:31.096268 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:31.096269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:31.096280 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:31.096324 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:31.096464 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.096909 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.097606 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.097784 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.097835 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.098325 (+ 490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:31.098326 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:31.098326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:31.098331 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:31.098344 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:31.098348 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:31.098388 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:31.098444 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 06:27:31.098468 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:27:31.099790 32397 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:27:31.101210 32397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:27:31.106854 810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.103284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:43355 (local address 127.0.0.1:49348)
0812 06:27:31.103563 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:31.103572 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:31.103617 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:31.103805 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:31.103806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:31.103808 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:31.103851 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:31.103853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.104721 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.104722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:31.105743 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:31.105745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.106582 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.106583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:31.106657 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.106671 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 06:27:31.106733 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:27:31.106784 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":3,"thread_start_us":61,"threads_started":1}
I20260812 06:27:31.106866 813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.103391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49348 (local address 127.30.15.67:43355)
0812 06:27:31.103580 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:31.103584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:31.103612 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:27:31.103672 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:31.103674 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:31.103686 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:31.103751 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:31.103920 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.104647 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.105833 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.106508 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.106566 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.106647 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:31.106756 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 06:27:31.106792 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":85,"threads_started":1}
I20260812 06:27:31.107060 806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.103173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34772 (local address 127.30.15.65:38009)
0812 06:27:31.103402 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:31.103406 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:31.103505 (+ 99us) server_negotiation.cc:407] Connection header received
0812 06:27:31.103625 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:31.103628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:31.103645 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:31.103724 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:31.103895 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.105013 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.106010 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.106606 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.106670 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.106751 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:31.106936 (+ 185us) server_negotiation.cc:299] Negotiation successful
0812 06:27:31.106979 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":111,"threads_started":1}
I20260812 06:27:31.107249 802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.103074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:38009 (local address 127.0.0.1:34772)
0812 06:27:31.103396 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:31.103436 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:31.103501 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:31.103736 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:31.103739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:31.103741 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:31.103801 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:31.103803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.105116 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.105116 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:31.105914 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:31.105917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.106785 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.106786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:31.106845 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.106848 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:27:31.107143 (+ 295us) client_negotiation.cc:240] Negotiation successful
0812 06:27:31.107185 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":93,"threads_started":1}
I20260812 06:27:31.107431 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.103068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:42949 (local address 127.0.0.1:42062)
0812 06:27:31.103395 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:31.103436 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:31.103494 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:31.104009 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:31.104010 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:31.104012 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:31.104046 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:31.104048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.105248 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.105249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:31.106275 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:31.106277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.107222 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.107223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:31.107303 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.107306 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:27:31.107356 (+ 50us) client_negotiation.cc:240] Negotiation successful
0812 06:27:31.107390 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":54,"threads_started":1}
I20260812 06:27:31.107646 807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.103168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42062 (local address 127.30.15.66:42949)
0812 06:27:31.103735 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:31.103740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:31.103749 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:27:31.103851 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:31.103853 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:31.103870 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:31.103939 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:31.104120 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.105165 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.106358 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.107034 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.107107 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.107190 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:31.107530 (+ 340us) server_negotiation.cc:299] Negotiation successful
0812 06:27:31.107569 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":121,"threads_started":1}
I20260812 06:27:31.107879 652 tablet_service.cc:1467] Processing CreateTablet for tablet d43456001a7e41f7bcb1218579f0ea19 (DEFAULT_TABLE table=test-table [id=3b5e0b7e25774e778273a36024154d3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:31.108019 32636 tablet_service.cc:1467] Processing CreateTablet for tablet d43456001a7e41f7bcb1218579f0ea19 (DEFAULT_TABLE table=test-table [id=3b5e0b7e25774e778273a36024154d3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:31.108266 652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d43456001a7e41f7bcb1218579f0ea19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:31.108232 409 tablet_service.cc:1467] Processing CreateTablet for tablet d43456001a7e41f7bcb1218579f0ea19 (DEFAULT_TABLE table=test-table [id=3b5e0b7e25774e778273a36024154d3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:31.108356 32636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d43456001a7e41f7bcb1218579f0ea19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:31.108547 409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d43456001a7e41f7bcb1218579f0ea19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:31.110802 814 tablet_bootstrap.cc:492] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0: Bootstrap starting.
I20260812 06:27:31.111490 814 tablet_bootstrap.cc:654] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:31.111819 814 log.cc:824] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:31.112336 819 tablet_bootstrap.cc:492] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84: Bootstrap starting.
I20260812 06:27:31.112833 814 tablet_bootstrap.cc:492] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0: No bootstrap required, opened a new log
I20260812 06:27:31.112916 814 ts_tablet_manager.cc:1397] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:27:31.113044 819 tablet_bootstrap.cc:654] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:31.113377 819 log.cc:824] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:31.113741 815 tablet_bootstrap.cc:492] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62: Bootstrap starting.
I20260812 06:27:31.114025 819 tablet_bootstrap.cc:492] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84: No bootstrap required, opened a new log
I20260812 06:27:31.114084 819 ts_tablet_manager.cc:1397] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:27:31.114435 815 tablet_bootstrap.cc:654] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:31.114753 815 log.cc:824] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:31.115578 815 tablet_bootstrap.cc:492] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62: No bootstrap required, opened a new log
I20260812 06:27:31.115653 815 ts_tablet_manager.cc:1397] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:27:31.115731 814 raft_consensus.cc:348] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6362f27e144ee5b228f1e93a58ed62" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42949 } } peers { permanent_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38009 } } peers { permanent_uuid: "0c5353697319421b95cd1ef84c7cbe84" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43355 } }
I20260812 06:27:31.115891 814 raft_consensus.cc:374] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:31.115935 814 raft_consensus.cc:729] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb7ff5f2e7f24771b8cebd5d45ed86c0, State: Initialized, Role: FOLLOWER
I20260812 06:27:31.116041 814 consensus_queue.cc:260] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6362f27e144ee5b228f1e93a58ed62" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42949 } } peers { permanent_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38009 } } peers { permanent_uuid: "0c5353697319421b95cd1ef84c7cbe84" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43355 } }
I20260812 06:27:31.116315 814 ts_tablet_manager.cc:1428] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260812 06:27:31.116348 32748 heartbeater.cc:503] Master 127.30.15.126:34435 was elected leader, sending a full tablet report...
I20260812 06:27:31.116314 819 raft_consensus.cc:348] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6362f27e144ee5b228f1e93a58ed62" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42949 } } peers { permanent_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38009 } } peers { permanent_uuid: "0c5353697319421b95cd1ef84c7cbe84" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43355 } }
I20260812 06:27:31.116465 819 raft_consensus.cc:374] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:31.116505 819 raft_consensus.cc:729] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c5353697319421b95cd1ef84c7cbe84, State: Initialized, Role: FOLLOWER
I20260812 06:27:31.116616 819 consensus_queue.cc:260] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6362f27e144ee5b228f1e93a58ed62" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42949 } } peers { permanent_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38009 } } peers { permanent_uuid: "0c5353697319421b95cd1ef84c7cbe84" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43355 } }
I20260812 06:27:31.116852 819 ts_tablet_manager.cc:1428] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:27:31.116914 778 heartbeater.cc:503] Master 127.30.15.126:34435 was elected leader, sending a full tablet report...
I20260812 06:27:31.118491 815 raft_consensus.cc:348] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6362f27e144ee5b228f1e93a58ed62" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42949 } } peers { permanent_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38009 } } peers { permanent_uuid: "0c5353697319421b95cd1ef84c7cbe84" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43355 } }
I20260812 06:27:31.118618 815 raft_consensus.cc:374] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:31.118638 815 raft_consensus.cc:729] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6362f27e144ee5b228f1e93a58ed62, State: Initialized, Role: FOLLOWER
I20260812 06:27:31.118712 815 consensus_queue.cc:260] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6362f27e144ee5b228f1e93a58ed62" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42949 } } peers { permanent_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38009 } } peers { permanent_uuid: "0c5353697319421b95cd1ef84c7cbe84" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43355 } }
I20260812 06:27:31.118891 815 ts_tablet_manager.cc:1428] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260812 06:27:31.118947 520 heartbeater.cc:503] Master 127.30.15.126:34435 was elected leader, sending a full tablet report...
I20260812 06:27:31.141299 826 raft_consensus.cc:482] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:27:31.141402 826 raft_consensus.cc:504] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6362f27e144ee5b228f1e93a58ed62" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42949 } } peers { permanent_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38009 } } peers { permanent_uuid: "0c5353697319421b95cd1ef84c7cbe84" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43355 } }
I20260812 06:27:31.141726 826 leader_election.cc:288] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6362f27e144ee5b228f1e93a58ed62 (127.30.15.66:42949), 0c5353697319421b95cd1ef84c7cbe84 (127.30.15.67:43355)
I20260812 06:27:31.144387 807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.141918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:53247 (local address 127.30.15.66:42949)
0812 06:27:31.141979 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:31.141981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:31.142009 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:27:31.142036 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:31.142037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:31.142046 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:31.142088 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:31.142256 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.142719 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.143697 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.144064 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.144124 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.144133 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:31.144272 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 06:27:31.144311 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:27:31.144387 32762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.141849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:42949 (local address 127.30.15.65:53247)
0812 06:27:31.141910 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:31.141922 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:31.141974 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:31.142138 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:31.142139 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:31.142140 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:31.142195 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:31.142196 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.142790 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.142791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:31.143619 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:31.143622 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.144139 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.144140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:31.144211 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.144213 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:27:31.144257 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:27:31.144322 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260812 06:27:31.144505 835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.141956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:43355 (local address 127.30.15.65:36731)
0812 06:27:31.142125 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:31.142134 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:31.142181 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:31.142306 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:31.142307 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:31.142308 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:31.142376 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:31.142377 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.142946 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.142947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:31.143755 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:31.143757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.144265 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.144266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:31.144346 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.144349 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:27:31.144393 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:27:31.144429 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":113,"threads_started":1}
I20260812 06:27:31.144505 813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.142034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:36731 (local address 127.30.15.67:43355)
0812 06:27:31.142083 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:31.142085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:31.142181 (+ 96us) server_negotiation.cc:407] Connection header received
0812 06:27:31.142240 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:31.142241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:31.142250 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:31.142296 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:31.142429 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.142874 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.143830 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.144191 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.144252 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.144260 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:31.144404 (+ 144us) server_negotiation.cc:299] Negotiation successful
0812 06:27:31.144440 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:27:31.144909 694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d43456001a7e41f7bcb1218579f0ea19" candidate_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5353697319421b95cd1ef84c7cbe84" is_pre_election: true
I20260812 06:27:31.144938 445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d43456001a7e41f7bcb1218579f0ea19" candidate_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6362f27e144ee5b228f1e93a58ed62" is_pre_election: true
I20260812 06:27:31.145040 694 raft_consensus.cc:2454] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb7ff5f2e7f24771b8cebd5d45ed86c0 in term 0.
I20260812 06:27:31.145051 445 raft_consensus.cc:2454] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb7ff5f2e7f24771b8cebd5d45ed86c0 in term 0.
I20260812 06:27:31.145277 32550 leader_election.cc:302] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6362f27e144ee5b228f1e93a58ed62, eb7ff5f2e7f24771b8cebd5d45ed86c0; no voters:
I20260812 06:27:31.145406 826 raft_consensus.cc:2781] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:27:31.145463 826 raft_consensus.cc:482] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:27:31.145479 826 raft_consensus.cc:3037] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:31.146165 826 raft_consensus.cc:504] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6362f27e144ee5b228f1e93a58ed62" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42949 } } peers { permanent_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38009 } } peers { permanent_uuid: "0c5353697319421b95cd1ef84c7cbe84" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43355 } }
I20260812 06:27:31.146266 826 leader_election.cc:288] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [CANDIDATE]: Term 1 election: Requested vote from peers 9a6362f27e144ee5b228f1e93a58ed62 (127.30.15.66:42949), 0c5353697319421b95cd1ef84c7cbe84 (127.30.15.67:43355)
I20260812 06:27:31.146447 445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d43456001a7e41f7bcb1218579f0ea19" candidate_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6362f27e144ee5b228f1e93a58ed62"
I20260812 06:27:31.146462 694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d43456001a7e41f7bcb1218579f0ea19" candidate_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c5353697319421b95cd1ef84c7cbe84"
I20260812 06:27:31.146533 694 raft_consensus.cc:3037] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:31.146533 445 raft_consensus.cc:3037] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:31.147406 445 raft_consensus.cc:2454] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb7ff5f2e7f24771b8cebd5d45ed86c0 in term 1.
I20260812 06:27:31.147446 694 raft_consensus.cc:2454] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb7ff5f2e7f24771b8cebd5d45ed86c0 in term 1.
I20260812 06:27:31.147586 32550 leader_election.cc:302] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c5353697319421b95cd1ef84c7cbe84, eb7ff5f2e7f24771b8cebd5d45ed86c0; no voters:
I20260812 06:27:31.147702 826 raft_consensus.cc:2781] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:31.147823 826 raft_consensus.cc:686] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 1 LEADER]: Becoming Leader. State: Replica: eb7ff5f2e7f24771b8cebd5d45ed86c0, State: Running, Role: LEADER
I20260812 06:27:31.147895 826 consensus_queue.cc:237] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6362f27e144ee5b228f1e93a58ed62" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42949 } } peers { permanent_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38009 } } peers { permanent_uuid: "0c5353697319421b95cd1ef84c7cbe84" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43355 } }
I20260812 06:27:31.148617 32396 catalog_manager.cc:5495] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb7ff5f2e7f24771b8cebd5d45ed86c0 (127.30.15.65). New cstate: current_term: 1 leader_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6362f27e144ee5b228f1e93a58ed62" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb7ff5f2e7f24771b8cebd5d45ed86c0" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c5353697319421b95cd1ef84c7cbe84" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43355 } health_report { overall_health: UNKNOWN } } }
I20260812 06:27:31.154830 806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.152925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34788 (local address 127.30.15.65:38009)
0812 06:27:31.152967 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:31.152969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:31.152977 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:27:31.153020 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:31.153021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:31.153048 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:31.153104 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:27:31.153192 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.153614 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.154261 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:31.154429 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:31.154471 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:31.154593 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:27:31.154680 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:27:31.154733 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:31.154744 (+ 11us) server_negotiation.cc:299] Negotiation successful
0812 06:27:31.154760 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:27:31.156373 694 raft_consensus.cc:1261] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84 [term 1 FOLLOWER]: Refusing update from remote peer eb7ff5f2e7f24771b8cebd5d45ed86c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:27:31.156396 445 raft_consensus.cc:1261] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62 [term 1 FOLLOWER]: Refusing update from remote peer eb7ff5f2e7f24771b8cebd5d45ed86c0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:27:31.156668 826 consensus_queue.cc:1035] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6362f27e144ee5b228f1e93a58ed62" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 42949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:27:31.156788 836 consensus_queue.cc:1035] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c5353697319421b95cd1ef84c7cbe84" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 43355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:27:31.158923 843 mvcc.cc:205] Tried to move back new op lower bound from 7317569745534435328 to 7317569745502375936. Current Snapshot: MvccSnapshot[applied={T|T < 7317569745534435328}]
I20260812 06:27:31.159605 849 mvcc.cc:205] Tried to move back new op lower bound from 7317569745534435328 to 7317569745502375936. Current Snapshot: MvccSnapshot[applied={T|T < 7317569745534435328 or (T in {7317569745534435328})}]
I20260812 06:27:31.161016 32397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:27:31.161114 32397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:27:31.161789 32397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6241e1975d94424b56660f70a96508a: Sending DeleteTablet for 3 replicas of tablet d43456001a7e41f7bcb1218579f0ea19
I20260812 06:27:31.162149 32636 tablet_service.cc:1514] Processing DeleteTablet for tablet d43456001a7e41f7bcb1218579f0ea19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:31 UTC) from {username='slave'} at 127.0.0.1:34772
I20260812 06:27:31.162179 409 tablet_service.cc:1514] Processing DeleteTablet for tablet d43456001a7e41f7bcb1218579f0ea19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:31 UTC) from {username='slave'} at 127.0.0.1:42062
I20260812 06:27:31.162185 652 tablet_service.cc:1514] Processing DeleteTablet for tablet d43456001a7e41f7bcb1218579f0ea19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:31 UTC) from {username='slave'} at 127.0.0.1:49348
I20260812 06:27:31.162397 863 tablet_replica.cc:330] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0: stopping tablet replica
I20260812 06:27:31.162441 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 32518
I20260812 06:27:31.162495 863 raft_consensus.cc:2229] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:27:31.162575 863 raft_consensus.cc:2258] T d43456001a7e41f7bcb1218579f0ea19 P eb7ff5f2e7f24771b8cebd5d45ed86c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:31.194597 864 tablet_replica.cc:330] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62: stopping tablet replica
I20260812 06:27:31.194756 864 raft_consensus.cc:2229] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:27:31.194859 871 tablet_replica.cc:330] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84: stopping tablet replica
I20260812 06:27:31.194892 864 raft_consensus.cc:2258] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:31.194975 871 raft_consensus.cc:2229] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:27:31.195083 871 raft_consensus.cc:2258] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:31.195483 864 ts_tablet_manager.cc:1905] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:27:31.196909 864 ts_tablet_manager.cc:1918] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:27:31.196973 864 log.cc:1196] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/d43456001a7e41f7bcb1218579f0ea19
I20260812 06:27:31.197187 864 ts_tablet_manager.cc:1939] T d43456001a7e41f7bcb1218579f0ea19 P 9a6362f27e144ee5b228f1e93a58ed62: Deleting consensus metadata
I20260812 06:27:31.197592 32378 catalog_manager.cc:4841] TS 9a6362f27e144ee5b228f1e93a58ed62 (127.30.15.66:42949): tablet d43456001a7e41f7bcb1218579f0ea19 (table test-table [id=3b5e0b7e25774e778273a36024154d3e]) successfully deleted
W20260812 06:27:31.199484 32374 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:38009 (error 108)
I20260812 06:27:31.199765 871 ts_tablet_manager.cc:1905] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:27:31.199956 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:31.199821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:38009 (local address 127.0.0.1:34792)
0812 06:27:31.199879 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:31.199922 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:38009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 06:27:31.199994 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 32763
W20260812 06:27:31.200070 32374 catalog_manager.cc:4584] TS eb7ff5f2e7f24771b8cebd5d45ed86c0 (127.30.15.65:38009): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d43456001a7e41f7bcb1218579f0ea19: Network error: Client connection negotiation failed: client connection to 127.30.15.65:38009: connect: Connection refused (error 111)
I20260812 06:27:31.201799 871 ts_tablet_manager.cc:1918] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:27:31.201858 871 log.cc:1196] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/d43456001a7e41f7bcb1218579f0ea19
I20260812 06:27:31.202065 871 ts_tablet_manager.cc:1939] T d43456001a7e41f7bcb1218579f0ea19 P 0c5353697319421b95cd1ef84c7cbe84: Deleting consensus metadata
I20260812 06:27:31.202394 32378 catalog_manager.cc:4841] TS 0c5353697319421b95cd1ef84c7cbe84 (127.30.15.67:43355): tablet d43456001a7e41f7bcb1218579f0ea19 (table test-table [id=3b5e0b7e25774e778273a36024154d3e]) successfully deleted
I20260812 06:27:31.211547 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 525
I20260812 06:27:31.231158 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 32342
2026-08-12T06:27:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (690 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:31 dist-test-slave-gjrz krb5kdc[880](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:31 dist-test-slave-gjrz krb5kdc[880](info): set up 2 sockets
Aug 12 06:27:31 dist-test-slave-gjrz krb5kdc[880](info): commencing operation
krb5kdc: starting...
W20260812 06:27:32.436865 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:32 dist-test-slave-gjrz krb5kdc[880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:27:32.548223 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:39615
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:42913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:39615
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:32.626216 907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:32.626396 907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:32.626427 907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:32.627534 907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:32.627573 907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:32.627591 907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:32.627606 907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:32.627622 907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:32.629035 907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:42913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:39615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:39615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:32.629248 907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:32.629443 907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:32.633972 918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:32.634009 913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:32.634060 914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:32.634200 907 server_base.cc:1034] running on GCE node
I20260812 06:27:32.634742 907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:32.635010 907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:32.636140 907 hybrid_clock.cc:648] HybridClock initialized: now 1786516052636127 us; error 31 us; skew 500 ppm
Aug 12 06:27:32 dist-test-slave-gjrz krb5kdc[880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516052, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:32.638600 907 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:27:32.639016 907 webserver.cc:460] Webserver started at http://127.30.15.126:35995/ using document root <none> and password file <none>
I20260812 06:27:32.639238 907 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:32.639313 907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:32.639418 907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:32.640331 907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "c311c27d0c6d401da11ffc1728464994"
format_stamp: "Formatted at 2026-08-12 06:27:32 on dist-test-slave-gjrz"
server_key: "94895b5a0b0bb2ea8bc04e2765803db5"
server_key_iv: "d1ad43b4b964b37ed645175c876e2cd4"
server_key_version: "encryptionkey@0"
I20260812 06:27:32.640605 907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "c311c27d0c6d401da11ffc1728464994"
format_stamp: "Formatted at 2026-08-12 06:27:32 on dist-test-slave-gjrz"
server_key: "94895b5a0b0bb2ea8bc04e2765803db5"
server_key_iv: "d1ad43b4b964b37ed645175c876e2cd4"
server_key_version: "encryptionkey@0"
I20260812 06:27:32.641732 907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:27:32.642342 927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:32.642498 907 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:32.642580 907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "c311c27d0c6d401da11ffc1728464994"
format_stamp: "Formatted at 2026-08-12 06:27:32 on dist-test-slave-gjrz"
server_key: "94895b5a0b0bb2ea8bc04e2765803db5"
server_key_iv: "d1ad43b4b964b37ed645175c876e2cd4"
server_key_version: "encryptionkey@0"
I20260812 06:27:32.642632 907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:32.673169 907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:32.674739 907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:32.674842 907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:32.678413 907 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:39615
I20260812 06:27:32.678452 1031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:39615 every 8 connection(s)
I20260812 06:27:32.678746 907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:32.679637 1038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:32.681809 1038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994: Bootstrap starting.
I20260812 06:27:32.682201 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 907
I20260812 06:27:32.682307 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:32.682405 1038 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:32.682502 30781 external_mini_cluster.cc:1428] Setting key bea37170212198c0a1ea640d4faa179f
I20260812 06:27:32.682700 1038 log.cc:824] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:32.683533 1038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994: No bootstrap required, opened a new log
I20260812 06:27:32.685921 1038 raft_consensus.cc:348] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c311c27d0c6d401da11ffc1728464994" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39615 } }
I20260812 06:27:32.686100 1038 raft_consensus.cc:374] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:32.686137 1038 raft_consensus.cc:729] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c311c27d0c6d401da11ffc1728464994, State: Initialized, Role: FOLLOWER
I20260812 06:27:32.686259 1038 consensus_queue.cc:260] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c311c27d0c6d401da11ffc1728464994" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39615 } }
I20260812 06:27:32.686337 1038 raft_consensus.cc:388] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:32.686359 1038 raft_consensus.cc:482] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:32.686403 1038 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:32.686916 1038 raft_consensus.cc:504] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c311c27d0c6d401da11ffc1728464994" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39615 } }
I20260812 06:27:32.687018 1038 leader_election.cc:302] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c311c27d0c6d401da11ffc1728464994; no voters:
I20260812 06:27:32.687176 1038 leader_election.cc:288] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:32.687223 1051 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:32.687402 1051 raft_consensus.cc:686] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [term 1 LEADER]: Becoming Leader. State: Replica: c311c27d0c6d401da11ffc1728464994, State: Running, Role: LEADER
I20260812 06:27:32.687423 1038 sys_catalog.cc:564] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:32.687491 1051 consensus_queue.cc:237] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c311c27d0c6d401da11ffc1728464994" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39615 } }
I20260812 06:27:32.687798 1051 sys_catalog.cc:455] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c311c27d0c6d401da11ffc1728464994. Latest consensus state: current_term: 1 leader_uuid: "c311c27d0c6d401da11ffc1728464994" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c311c27d0c6d401da11ffc1728464994" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39615 } } }
I20260812 06:27:32.687888 1051 sys_catalog.cc:458] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:32.688024 1052 sys_catalog.cc:455] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c311c27d0c6d401da11ffc1728464994" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c311c27d0c6d401da11ffc1728464994" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39615 } } }
I20260812 06:27:32.688120 1052 sys_catalog.cc:458] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:32.688458 1072 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:32.688935 1072 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 06:27:32 dist-test-slave-gjrz krb5kdc[880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:32.690407 1072 catalog_manager.cc:1347] Generated new cluster ID: 6f2c5cb7c5c34d6e85bf3141ce3ff8e3
I20260812 06:27:32.690456 1072 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:32.693132 1049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:32.682980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50578 (local address 127.30.15.126:39615)
0812 06:27:32.683165 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:32.683174 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:32.683315 (+ 141us) server_negotiation.cc:407] Connection header received
0812 06:27:32.683929 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:32.683939 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:32.683999 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:32.684146 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:32.684708 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:32.686090 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:32.686947 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:32.687602 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:32.687741 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:32.690238 (+ 2497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:32.690241 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:32.690242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:32.690252 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:32.691804 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:32.692117 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:32.692120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:32.692120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:32.692200 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:32.692371 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:32.692372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:32.692372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:32.692589 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:32.692740 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:32.692809 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 06:27:32.692931 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":100,"threads_started":1}
I20260812 06:27:32.709563 1072 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:32.710052 1072 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:32.715217 1072 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994: Generated new TSK 0
I20260812 06:27:32.715382 1072 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:27:32.743377 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39615
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:42913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:32.822695 1094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:32.822886 1094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:32.822917 1094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:32.824060 1094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:32.824100 1094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:32.824134 1094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:27:32.825559 1094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:42913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:32.825790 1094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:32.825990 1094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:32.830693 1106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:32.830837 1094 server_base.cc:1034] running on GCE node
W20260812 06:27:32.830701 1104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:32.830722 1103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:32.831133 1094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:32.831390 1094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:32.832528 1094 hybrid_clock.cc:648] HybridClock initialized: now 1786516052832513 us; error 29 us; skew 500 ppm
Aug 12 06:27:32 dist-test-slave-gjrz krb5kdc[880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516052, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:32.834833 1094 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:27:32.835208 1094 webserver.cc:460] Webserver started at http://127.30.15.65:35537/ using document root <none> and password file <none>
I20260812 06:27:32.835434 1094 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:32.835484 1094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:32.835609 1094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:32.836560 1094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "a67f21cbf4c74079a599237fa40cefef"
format_stamp: "Formatted at 2026-08-12 06:27:32 on dist-test-slave-gjrz"
server_key: "cf61e68be3c2be64d85c056ebc1a0c37"
server_key_iv: "87141067670bc19d1378b44faf7018fe"
server_key_version: "encryptionkey@0"
I20260812 06:27:32.836877 1094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "a67f21cbf4c74079a599237fa40cefef"
format_stamp: "Formatted at 2026-08-12 06:27:32 on dist-test-slave-gjrz"
server_key: "cf61e68be3c2be64d85c056ebc1a0c37"
server_key_iv: "87141067670bc19d1378b44faf7018fe"
server_key_version: "encryptionkey@0"
I20260812 06:27:32.838066 1094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:27:32.838699 1117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:32.838840 1094 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:32.838920 1094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "a67f21cbf4c74079a599237fa40cefef"
format_stamp: "Formatted at 2026-08-12 06:27:32 on dist-test-slave-gjrz"
server_key: "cf61e68be3c2be64d85c056ebc1a0c37"
server_key_iv: "87141067670bc19d1378b44faf7018fe"
server_key_version: "encryptionkey@0"
I20260812 06:27:32.838979 1094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:32.852401 1094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:32.854080 1094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:32.854208 1094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:32.854399 1094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:32.854686 1094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:32.854719 1094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:32.854746 1094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:32.854763 1094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:32.860163 1094 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:45757
I20260812 06:27:32.860226 1354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:45757 every 8 connection(s)
I20260812 06:27:32.860476 1094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:27:32 dist-test-slave-gjrz krb5kdc[880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516052, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:32.867993 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 1094
I20260812 06:27:32.868106 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:27:32.868335 30781 external_mini_cluster.cc:1428] Setting key e54bcca1c9e8944ef2762f449630261d
I20260812 06:27:32.868780 1049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:32.861117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:35789 (local address 127.30.15.126:39615)
0812 06:27:32.861169 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:32.861171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:32.861352 (+ 181us) server_negotiation.cc:407] Connection header received
0812 06:27:32.861778 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:32.861779 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:32.861788 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:32.861832 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:32.862682 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:32.863171 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:32.864151 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:32.864338 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:32.864385 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:32.866290 (+ 1905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:32.866292 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:32.866292 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:32.866298 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:32.867513 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:32.867846 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:32.867847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:32.867847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:32.867908 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:32.868145 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:32.868146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:32.868146 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:32.868282 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:32.868350 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:32.868605 (+ 255us) server_negotiation.cc:299] Negotiation successful
0812 06:27:32.868689 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:27:32.868884 1361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:32.861088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39615 (local address 127.30.15.65:35789)
0812 06:27:32.861243 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:32.861275 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:32.861705 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:32.861901 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:32.861904 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:32.862433 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:32.862614 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:32.862619 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:32.863234 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:32.863234 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:32.864082 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:32.864084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:32.864411 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:32.864412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:32.864526 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:32.864911 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:27:32.864919 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:32.866210 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:32.867585 (+ 1375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:32.867591 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:32.867593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:32.867788 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:32.867963 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:32.867963 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:32.867963 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:32.868060 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:32.868341 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:32.868347 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:32.868478 (+ 131us) client_negotiation.cc:769] Sending connection context
0812 06:27:32.868572 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 06:27:32.868720 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
I20260812 06:27:32.869349 1355 heartbeater.cc:347] Connected to a master server at 127.30.15.126:39615
I20260812 06:27:32.869429 1355 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:32.869588 1355 heartbeater.cc:511] Master 127.30.15.126:39615 requested a full tablet report, sending...
I20260812 06:27:32.870087 957 ts_manager.cc:194] Registered new tserver with Master: a67f21cbf4c74079a599237fa40cefef (127.30.15.65:45757)
I20260812 06:27:32.870666 957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:35789
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:27:32.891736 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39615
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:42913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:32.971670 1367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:32.971850 1367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:32.971872 1367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:32.972923 1367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:32.972956 1367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:32.972980 1367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:27:32.974606 1367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:42913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:32.974794 1367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:32.974965 1367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:32.979627 1382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:32.979784 1367 server_base.cc:1034] running on GCE node
W20260812 06:27:32.979651 1380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:32.979934 1379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:32.980158 1367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:32.980408 1367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:32.981542 1367 hybrid_clock.cc:648] HybridClock initialized: now 1786516052981527 us; error 33 us; skew 500 ppm
Aug 12 06:27:32 dist-test-slave-gjrz krb5kdc[880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516052, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:32.983901 1367 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:27:32.984283 1367 webserver.cc:460] Webserver started at http://127.30.15.66:38117/ using document root <none> and password file <none>
I20260812 06:27:32.984445 1367 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:32.984494 1367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:32.984583 1367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:32.985492 1367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "0d504fffd7e04269865d2c0d1b33c5cc"
format_stamp: "Formatted at 2026-08-12 06:27:32 on dist-test-slave-gjrz"
server_key: "02a4c2ab3f3ed7647b3bb492b0d164c0"
server_key_iv: "516a7cb15d9df0c4eba66bdf977b5a9e"
server_key_version: "encryptionkey@0"
I20260812 06:27:32.985774 1367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "0d504fffd7e04269865d2c0d1b33c5cc"
format_stamp: "Formatted at 2026-08-12 06:27:32 on dist-test-slave-gjrz"
server_key: "02a4c2ab3f3ed7647b3bb492b0d164c0"
server_key_iv: "516a7cb15d9df0c4eba66bdf977b5a9e"
server_key_version: "encryptionkey@0"
I20260812 06:27:32.986893 1367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:27:32.987605 1398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:32.987798 1367 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260812 06:27:32.987885 1367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "0d504fffd7e04269865d2c0d1b33c5cc"
format_stamp: "Formatted at 2026-08-12 06:27:32 on dist-test-slave-gjrz"
server_key: "02a4c2ab3f3ed7647b3bb492b0d164c0"
server_key_iv: "516a7cb15d9df0c4eba66bdf977b5a9e"
server_key_version: "encryptionkey@0"
I20260812 06:27:32.987947 1367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:33.006685 1367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:33.008739 1367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:33.008873 1367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:33.009091 1367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:33.009506 1367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:33.009558 1367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.009590 1367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:33.009606 1367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.015120 1367 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:36489
I20260812 06:27:33.015184 1646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:36489 every 8 connection(s)
I20260812 06:27:33.015476 1367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:27:33.015945 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 1367
I20260812 06:27:33.016053 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:27:33.016274 30781 external_mini_cluster.cc:1428] Setting key 288ee8811514fd4e51119eb89afb4eea
Aug 12 06:27:33 dist-test-slave-gjrz krb5kdc[880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516052, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:33.025096 1049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.016174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:50239 (local address 127.30.15.126:39615)
0812 06:27:33.016230 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:33.016232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:33.016480 (+ 248us) server_negotiation.cc:407] Connection header received
0812 06:27:33.017096 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:33.017097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:33.017106 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:33.017166 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:33.018338 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.018838 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.019891 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.020162 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.020225 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.022477 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:33.022479 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:33.022479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:33.022486 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:33.023756 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:33.024206 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:33.024206 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:33.024207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:33.024253 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:33.024525 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:33.024525 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:33.024526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:33.024621 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:33.024665 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:33.024967 (+ 302us) server_negotiation.cc:299] Negotiation successful
0812 06:27:33.025026 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260812 06:27:33.025336 1649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.016158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39615 (local address 127.30.15.66:50239)
0812 06:27:33.016334 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:33.016383 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:33.016986 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:33.017250 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:33.017255 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:33.017963 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:33.018223 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.018229 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.018946 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.018947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.019802 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.019805 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.020248 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.020249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.020365 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.020766 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:27:33.020774 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:33.022385 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:33.023837 (+ 1452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:33.023846 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:33.023848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:33.024136 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:33.024311 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:33.024311 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:33.024312 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:33.024451 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:33.024676 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:33.024682 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:33.024839 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 06:27:33.024957 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 06:27:33.025119 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":87,"threads_started":1}
I20260812 06:27:33.025810 1647 heartbeater.cc:347] Connected to a master server at 127.30.15.126:39615
I20260812 06:27:33.025894 1647 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
I20260812 06:27:33.026072 1647 heartbeater.cc:511] Master 127.30.15.126:39615 requested a full tablet report, sending...
I20260812 06:27:33.026424 957 ts_manager.cc:194] Registered new tserver with Master: 0d504fffd7e04269865d2c0d1b33c5cc (127.30.15.66:36489)
I20260812 06:27:33.026750 957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:50239
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:27:33.042057 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39615
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:42913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:33.123188 1659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:33.123394 1659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:33.123426 1659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:33.124529 1659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:33.124569 1659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:33.124604 1659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:27:33.126036 1659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:42913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:33.126266 1659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:33.126464 1659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:33.131186 1673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:33.131175 1670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:33.131175 1668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:33.131326 1659 server_base.cc:1034] running on GCE node
I20260812 06:27:33.131606 1659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:33.131834 1659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:33.132974 1659 hybrid_clock.cc:648] HybridClock initialized: now 1786516053132943 us; error 48 us; skew 500 ppm
Aug 12 06:27:33 dist-test-slave-gjrz krb5kdc[880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516053, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:33.135340 1659 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:27:33.135737 1659 webserver.cc:460] Webserver started at http://127.30.15.67:37229/ using document root <none> and password file <none>
I20260812 06:27:33.135936 1659 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:33.135982 1659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:33.136102 1659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:33.137069 1659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "58b4936cefbb47b09f98d25260f7752c"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "af837283eb733cf72d712732f829c387"
server_key_iv: "24cd4dcca7572809878dc10d4b786b6b"
server_key_version: "encryptionkey@0"
I20260812 06:27:33.137531 1659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "58b4936cefbb47b09f98d25260f7752c"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "af837283eb733cf72d712732f829c387"
server_key_iv: "24cd4dcca7572809878dc10d4b786b6b"
server_key_version: "encryptionkey@0"
I20260812 06:27:33.138777 1659 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:27:33.139442 1685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.139583 1659 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:33.139665 1659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "58b4936cefbb47b09f98d25260f7752c"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "af837283eb733cf72d712732f829c387"
server_key_iv: "24cd4dcca7572809878dc10d4b786b6b"
server_key_version: "encryptionkey@0"
I20260812 06:27:33.139732 1659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:33.173942 1659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:33.176024 1659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:33.176179 1659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:33.176395 1659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:33.176687 1659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:33.176720 1659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.176749 1659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:33.176766 1659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.182574 1659 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:40991
I20260812 06:27:33.182680 1933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:40991 every 8 connection(s)
I20260812 06:27:33.182919 1659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:27:33.187654 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 1659
I20260812 06:27:33.187799 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:27:33.188005 30781 external_mini_cluster.cc:1428] Setting key 85a958a9c15916dd075b0d18d203e9ad
Aug 12 06:27:33 dist-test-slave-gjrz krb5kdc[880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516053, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:33.191843 1049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.183607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:51379 (local address 127.30.15.126:39615)
0812 06:27:33.183667 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:33.183669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:33.183864 (+ 195us) server_negotiation.cc:407] Connection header received
0812 06:27:33.184407 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:33.184409 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:33.184422 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:33.184472 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:33.185413 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.185914 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.186886 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.187096 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.187152 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.189437 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:33.189438 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:33.189439 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:33.189446 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:33.190509 (+ 1063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:33.190876 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:33.190878 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:33.190878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:33.190938 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:33.191166 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:33.191167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:33.191167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:33.191313 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:33.191372 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:33.191675 (+ 303us) server_negotiation.cc:299] Negotiation successful
0812 06:27:33.191756 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:27:33.192013 1938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.183587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39615 (local address 127.30.15.67:51379)
0812 06:27:33.183746 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:33.183782 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:33.184294 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:33.184550 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:33.184555 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:33.185125 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:33.185308 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.185314 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.186007 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.186009 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.186796 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.186798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.187175 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.187176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.187321 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.187739 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:27:33.187750 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:33.189344 (+ 1594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:33.190585 (+ 1241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:33.190593 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:33.190595 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:33.190804 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:33.190997 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:33.190998 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:33.190998 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:33.191101 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:33.191373 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:33.191381 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:33.191554 (+ 173us) client_negotiation.cc:769] Sending connection context
0812 06:27:33.191643 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 06:27:33.191792 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260812 06:27:33.192456 1934 heartbeater.cc:347] Connected to a master server at 127.30.15.126:39615
I20260812 06:27:33.192534 1934 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:33.192696 1934 heartbeater.cc:511] Master 127.30.15.126:39615 requested a full tablet report, sending...
I20260812 06:27:33.193039 957 ts_manager.cc:194] Registered new tserver with Master: 58b4936cefbb47b09f98d25260f7752c (127.30.15.67:40991)
I20260812 06:27:33.193392 957 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:51379
I20260812 06:27:33.199779 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:27:33.206410 1049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.201029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50582 (local address 127.30.15.126:39615)
0812 06:27:33.201081 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:33.201082 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:33.201162 (+ 80us) server_negotiation.cc:407] Connection header received
0812 06:27:33.201199 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:33.201200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:33.201207 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:33.201252 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:33.201710 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.202181 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.202913 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.203110 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.203160 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.204340 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:33.204341 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:33.204342 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:33.204348 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:33.205468 (+ 1120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:33.205806 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:33.205806 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:33.205807 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:33.205855 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:33.206033 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:33.206033 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:33.206034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:33.206146 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:33.206221 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:33.206307 (+ 86us) server_negotiation.cc:299] Negotiation successful
0812 06:27:33.206354 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:27:33.207814 957 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50582:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:27:33.209308 957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:27:33.215463 1952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.211410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44664 (local address 127.30.15.66:36489)
0812 06:27:33.211615 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:33.211619 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:33.211859 (+ 240us) server_negotiation.cc:407] Connection header received
0812 06:27:33.211904 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:33.211906 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:33.211920 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:33.211990 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:33.212206 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.212960 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.214404 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.215134 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.215209 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.215290 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:33.215364 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 06:27:33.215402 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":102,"threads_started":1}
I20260812 06:27:33.215479 1949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.211201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:45757 (local address 127.0.0.1:55260)
0812 06:27:33.211614 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:33.211649 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:33.211702 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:33.211899 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:33.211903 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:33.211906 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:33.211978 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.211980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.213311 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.213312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.214391 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.214394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.215122 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.215123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.215205 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.215219 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 06:27:33.215342 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 06:27:33.215409 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":24,"thread_start_us":52,"threads_started":1}
I20260812 06:27:33.215572 1948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.211215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:40991 (local address 127.0.0.1:54420)
0812 06:27:33.211887 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:33.211895 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:33.211932 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:33.212247 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:33.212248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:33.212250 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:33.212286 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.212288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.213452 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.213453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.214329 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.214332 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.215380 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.215380 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.215427 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.215430 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:27:33.215484 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:27:33.215517 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":74,"threads_started":1}
I20260812 06:27:33.215641 1954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.211460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54420 (local address 127.30.15.67:40991)
0812 06:27:33.211643 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:33.211648 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:33.211983 (+ 335us) server_negotiation.cc:407] Connection header received
0812 06:27:33.212022 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:33.212024 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:33.212109 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:33.212177 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:33.212356 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.213365 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.214412 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.215143 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.215208 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.215296 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:33.215516 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 06:27:33.215563 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":72,"threads_started":1}
I20260812 06:27:33.215868 1950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.211201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:36489 (local address 127.0.0.1:44664)
0812 06:27:33.211794 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:33.211800 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:33.211834 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:33.211993 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:33.211994 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:33.211996 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:33.212042 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.212044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.213057 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.213058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.214314 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.214317 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.215206 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.215207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.215287 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.215291 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:33.215348 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:27:33.215817 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"mutex_wait_us":430,"thread_start_us":74,"threads_started":1}
I20260812 06:27:33.216151 1953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.211419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55260 (local address 127.30.15.65:45757)
0812 06:27:33.211690 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:33.211693 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:33.211703 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:27:33.211783 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:33.211784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:33.211796 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:33.211877 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:33.212078 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.213205 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.214458 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.215022 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.215090 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.215152 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:33.216029 (+ 877us) server_negotiation.cc:299] Negotiation successful
0812 06:27:33.216078 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":97,"threads_started":1}
I20260812 06:27:33.216349 1794 tablet_service.cc:1467] Processing CreateTablet for tablet d70d02ad775b4f32b6d8d2d8a759fcab (DEFAULT_TABLE table=test-table [id=d0e504559b0d42c58da83ff0aade1e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:33.216521 1503 tablet_service.cc:1467] Processing CreateTablet for tablet d70d02ad775b4f32b6d8d2d8a759fcab (DEFAULT_TABLE table=test-table [id=d0e504559b0d42c58da83ff0aade1e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:33.216703 1794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d70d02ad775b4f32b6d8d2d8a759fcab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:33.216861 1503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d70d02ad775b4f32b6d8d2d8a759fcab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:33.216804 1219 tablet_service.cc:1467] Processing CreateTablet for tablet d70d02ad775b4f32b6d8d2d8a759fcab (DEFAULT_TABLE table=test-table [id=d0e504559b0d42c58da83ff0aade1e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:33.217084 1219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d70d02ad775b4f32b6d8d2d8a759fcab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:33.219662 1955 tablet_bootstrap.cc:492] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc: Bootstrap starting.
I20260812 06:27:33.219952 1956 tablet_bootstrap.cc:492] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c: Bootstrap starting.
I20260812 06:27:33.220288 1958 tablet_bootstrap.cc:492] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef: Bootstrap starting.
I20260812 06:27:33.220516 1955 tablet_bootstrap.cc:654] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:33.220536 1956 tablet_bootstrap.cc:654] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:33.220837 1958 tablet_bootstrap.cc:654] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:33.221089 1956 log.cc:824] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:33.221084 1955 log.cc:824] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:33.221329 1958 log.cc:824] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:33.221825 1956 tablet_bootstrap.cc:492] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c: No bootstrap required, opened a new log
I20260812 06:27:33.221894 1956 ts_tablet_manager.cc:1397] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:27:33.222033 1958 tablet_bootstrap.cc:492] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef: No bootstrap required, opened a new log
I20260812 06:27:33.222090 1958 ts_tablet_manager.cc:1397] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:27:33.223460 1958 raft_consensus.cc:348] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 36489 } } peers { permanent_uuid: "a67f21cbf4c74079a599237fa40cefef" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45757 } } peers { permanent_uuid: "58b4936cefbb47b09f98d25260f7752c" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 40991 } }
I20260812 06:27:33.223594 1958 raft_consensus.cc:374] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:33.223510 1956 raft_consensus.cc:348] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 36489 } } peers { permanent_uuid: "a67f21cbf4c74079a599237fa40cefef" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45757 } } peers { permanent_uuid: "58b4936cefbb47b09f98d25260f7752c" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 40991 } }
I20260812 06:27:33.223630 1956 raft_consensus.cc:374] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:33.223628 1958 raft_consensus.cc:729] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67f21cbf4c74079a599237fa40cefef, State: Initialized, Role: FOLLOWER
I20260812 06:27:33.223670 1956 raft_consensus.cc:729] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58b4936cefbb47b09f98d25260f7752c, State: Initialized, Role: FOLLOWER
I20260812 06:27:33.223762 1958 consensus_queue.cc:260] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 36489 } } peers { permanent_uuid: "a67f21cbf4c74079a599237fa40cefef" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45757 } } peers { permanent_uuid: "58b4936cefbb47b09f98d25260f7752c" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 40991 } }
I20260812 06:27:33.223779 1956 consensus_queue.cc:260] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 36489 } } peers { permanent_uuid: "a67f21cbf4c74079a599237fa40cefef" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45757 } } peers { permanent_uuid: "58b4936cefbb47b09f98d25260f7752c" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 40991 } }
I20260812 06:27:33.224025 1956 ts_tablet_manager.cc:1428] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:27:33.224040 1958 ts_tablet_manager.cc:1428] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 06:27:33.224087 1934 heartbeater.cc:503] Master 127.30.15.126:39615 was elected leader, sending a full tablet report...
I20260812 06:27:33.224159 1355 heartbeater.cc:503] Master 127.30.15.126:39615 was elected leader, sending a full tablet report...
I20260812 06:27:33.224406 1955 tablet_bootstrap.cc:492] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc: No bootstrap required, opened a new log
I20260812 06:27:33.224478 1955 ts_tablet_manager.cc:1397] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 06:27:33.226006 1955 raft_consensus.cc:348] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 36489 } } peers { permanent_uuid: "a67f21cbf4c74079a599237fa40cefef" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45757 } } peers { permanent_uuid: "58b4936cefbb47b09f98d25260f7752c" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 40991 } }
I20260812 06:27:33.226131 1955 raft_consensus.cc:374] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:33.226151 1955 raft_consensus.cc:729] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d504fffd7e04269865d2c0d1b33c5cc, State: Initialized, Role: FOLLOWER
I20260812 06:27:33.226226 1955 consensus_queue.cc:260] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 36489 } } peers { permanent_uuid: "a67f21cbf4c74079a599237fa40cefef" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45757 } } peers { permanent_uuid: "58b4936cefbb47b09f98d25260f7752c" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 40991 } }
I20260812 06:27:33.226445 1955 ts_tablet_manager.cc:1428] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:27:33.226501 1647 heartbeater.cc:503] Master 127.30.15.126:39615 was elected leader, sending a full tablet report...
W20260812 06:27:33.266022 1648 tablet.cc:2369] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:27:33.319828 1967 raft_consensus.cc:482] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:27:33.319948 1967 raft_consensus.cc:504] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 36489 } } peers { permanent_uuid: "a67f21cbf4c74079a599237fa40cefef" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45757 } } peers { permanent_uuid: "58b4936cefbb47b09f98d25260f7752c" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 40991 } }
I20260812 06:27:33.320272 1967 leader_election.cc:288] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a67f21cbf4c74079a599237fa40cefef (127.30.15.65:45757), 58b4936cefbb47b09f98d25260f7752c (127.30.15.67:40991)
I20260812 06:27:33.322979 1953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.320492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:39875 (local address 127.30.15.65:45757)
0812 06:27:33.320573 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:33.320575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:33.320584 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:27:33.320614 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:33.320615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:33.320626 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:33.320688 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:33.320849 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.321316 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.322272 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.322658 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.322720 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.322730 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:33.322880 (+ 150us) server_negotiation.cc:299] Negotiation successful
0812 06:27:33.322917 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 06:27:33.322979 1649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.320430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:45757 (local address 127.30.15.66:39875)
0812 06:27:33.320490 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:33.320501 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:33.320545 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:33.320707 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:33.320709 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:33.320710 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:33.320778 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.320780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.321393 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.321394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.322174 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.322176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.322737 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.322738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.322813 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.322816 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:27:33.322861 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:27:33.322903 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":23}
I20260812 06:27:33.323103 1954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.320597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:37039 (local address 127.30.15.67:40991)
0812 06:27:33.320643 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:33.320644 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:33.320690 (+ 46us) server_negotiation.cc:407] Connection header received
0812 06:27:33.320755 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:33.320756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:33.320765 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:33.320807 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:33.320967 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.321421 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.322384 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.322761 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.322826 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.322834 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:33.323007 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 06:27:33.323042 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:27:33.323107 1969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.320459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:40991 (local address 127.30.15.66:37039)
0812 06:27:33.320641 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:33.320650 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:33.320696 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:33.320822 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:33.320823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:33.320824 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:33.320901 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.320903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.321506 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.321507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.322288 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.322291 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.322850 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.322851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.322928 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.322931 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:27:33.322983 (+ 52us) client_negotiation.cc:240] Negotiation successful
0812 06:27:33.323022 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":2,"thread_start_us":133,"threads_started":1}
I20260812 06:27:33.323345 1258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d70d02ad775b4f32b6d8d2d8a759fcab" candidate_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67f21cbf4c74079a599237fa40cefef" is_pre_election: true
I20260812 06:27:33.323519 1258 raft_consensus.cc:2454] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d504fffd7e04269865d2c0d1b33c5cc in term 0.
I20260812 06:27:33.323601 1830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d70d02ad775b4f32b6d8d2d8a759fcab" candidate_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58b4936cefbb47b09f98d25260f7752c" is_pre_election: true
I20260812 06:27:33.323750 1830 raft_consensus.cc:2454] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d504fffd7e04269865d2c0d1b33c5cc in term 0.
I20260812 06:27:33.323767 1404 leader_election.cc:302] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d504fffd7e04269865d2c0d1b33c5cc, a67f21cbf4c74079a599237fa40cefef; no voters:
I20260812 06:27:33.323882 1967 raft_consensus.cc:2781] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:27:33.323935 1967 raft_consensus.cc:482] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:27:33.323951 1967 raft_consensus.cc:3037] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:33.324677 1967 raft_consensus.cc:504] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 36489 } } peers { permanent_uuid: "a67f21cbf4c74079a599237fa40cefef" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45757 } } peers { permanent_uuid: "58b4936cefbb47b09f98d25260f7752c" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 40991 } }
I20260812 06:27:33.324792 1967 leader_election.cc:288] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [CANDIDATE]: Term 1 election: Requested vote from peers a67f21cbf4c74079a599237fa40cefef (127.30.15.65:45757), 58b4936cefbb47b09f98d25260f7752c (127.30.15.67:40991)
I20260812 06:27:33.324959 1830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d70d02ad775b4f32b6d8d2d8a759fcab" candidate_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58b4936cefbb47b09f98d25260f7752c"
I20260812 06:27:33.325034 1830 raft_consensus.cc:3037] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:33.325026 1258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d70d02ad775b4f32b6d8d2d8a759fcab" candidate_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67f21cbf4c74079a599237fa40cefef"
I20260812 06:27:33.325119 1258 raft_consensus.cc:3037] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:33.325878 1830 raft_consensus.cc:2454] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d504fffd7e04269865d2c0d1b33c5cc in term 1.
I20260812 06:27:33.326043 1258 raft_consensus.cc:2454] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d504fffd7e04269865d2c0d1b33c5cc in term 1.
I20260812 06:27:33.326066 1400 leader_election.cc:302] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d504fffd7e04269865d2c0d1b33c5cc, 58b4936cefbb47b09f98d25260f7752c; no voters:
I20260812 06:27:33.326144 1967 raft_consensus.cc:2781] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:33.326308 1967 raft_consensus.cc:686] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 1 LEADER]: Becoming Leader. State: Replica: 0d504fffd7e04269865d2c0d1b33c5cc, State: Running, Role: LEADER
I20260812 06:27:33.326404 1967 consensus_queue.cc:237] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 36489 } } peers { permanent_uuid: "a67f21cbf4c74079a599237fa40cefef" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45757 } } peers { permanent_uuid: "58b4936cefbb47b09f98d25260f7752c" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 40991 } }
I20260812 06:27:33.327208 957 catalog_manager.cc:5495] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d504fffd7e04269865d2c0d1b33c5cc (127.30.15.66). New cstate: current_term: 1 leader_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d504fffd7e04269865d2c0d1b33c5cc" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 36489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a67f21cbf4c74079a599237fa40cefef" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58b4936cefbb47b09f98d25260f7752c" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 40991 } health_report { overall_health: UNKNOWN } } }
I20260812 06:27:33.358632 1952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.356388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44668 (local address 127.30.15.66:36489)
0812 06:27:33.356459 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:33.356461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:33.356470 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:27:33.356505 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:33.356507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:33.356527 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:33.356587 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:27:33.356700 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.357145 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.357892 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.358079 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.358133 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.358289 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:27:33.358379 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:27:33.358485 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:33.358535 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 06:27:33.358545 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:27:33.360409 1258 raft_consensus.cc:1261] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef [term 1 FOLLOWER]: Refusing update from remote peer 0d504fffd7e04269865d2c0d1b33c5cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:27:33.360409 1830 raft_consensus.cc:1261] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c [term 1 FOLLOWER]: Refusing update from remote peer 0d504fffd7e04269865d2c0d1b33c5cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:27:33.360764 1967 consensus_queue.cc:1035] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "58b4936cefbb47b09f98d25260f7752c" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 40991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:27:33.360939 1970 consensus_queue.cc:1035] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67f21cbf4c74079a599237fa40cefef" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:27:33.361218 1356 tablet.cc:2369] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:27:33.363333 1978 mvcc.cc:205] Tried to move back new op lower bound from 7317569754561597440 to 7317569754425581568. Current Snapshot: MvccSnapshot[applied={T|T < 7317569754561597440}]
I20260812 06:27:33.364126 1980 mvcc.cc:205] Tried to move back new op lower bound from 7317569754561597440 to 7317569754425581568. Current Snapshot: MvccSnapshot[applied={T|T < 7317569754561597440}]
I20260812 06:27:33.364717 1979 mvcc.cc:205] Tried to move back new op lower bound from 7317569754561597440 to 7317569754425581568. Current Snapshot: MvccSnapshot[applied={T|T < 7317569754561597440 or (T in {7317569754561597440})}]
I20260812 06:27:33.365695 954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:27:33.365775 954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:27:33.366498 954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c311c27d0c6d401da11ffc1728464994: Sending DeleteTablet for 3 replicas of tablet d70d02ad775b4f32b6d8d2d8a759fcab
I20260812 06:27:33.366804 1219 tablet_service.cc:1514] Processing DeleteTablet for tablet d70d02ad775b4f32b6d8d2d8a759fcab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:33 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:55260
I20260812 06:27:33.366801 1503 tablet_service.cc:1514] Processing DeleteTablet for tablet d70d02ad775b4f32b6d8d2d8a759fcab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:33 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:44664
I20260812 06:27:33.366858 1794 tablet_service.cc:1514] Processing DeleteTablet for tablet d70d02ad775b4f32b6d8d2d8a759fcab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:33 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:54420
I20260812 06:27:33.367126 1999 tablet_replica.cc:330] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef: stopping tablet replica
I20260812 06:27:33.367146 1998 tablet_replica.cc:330] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc: stopping tablet replica
I20260812 06:27:33.367231 1998 raft_consensus.cc:2229] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:27:33.367350 1998 raft_consensus.cc:2258] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:33.367462 1999 raft_consensus.cc:2229] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:27:33.367520 2002 tablet_replica.cc:330] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c: stopping tablet replica
I20260812 06:27:33.367602 2002 raft_consensus.cc:2229] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:27:33.367693 2002 raft_consensus.cc:2258] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:33.368079 1998 ts_tablet_manager.cc:1905] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:27:33.367623 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 1094
I20260812 06:27:33.368614 1999 raft_consensus.cc:2258] T d70d02ad775b4f32b6d8d2d8a759fcab P a67f21cbf4c74079a599237fa40cefef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:33.375501 2002 ts_tablet_manager.cc:1905] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:27:33.377067 2002 ts_tablet_manager.cc:1918] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:27:33.377189 2002 log.cc:1196] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/d70d02ad775b4f32b6d8d2d8a759fcab
I20260812 06:27:33.377465 2002 ts_tablet_manager.cc:1939] T d70d02ad775b4f32b6d8d2d8a759fcab P 58b4936cefbb47b09f98d25260f7752c: Deleting consensus metadata
I20260812 06:27:33.378713 1998 ts_tablet_manager.cc:1918] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:27:33.378782 1998 log.cc:1196] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/d70d02ad775b4f32b6d8d2d8a759fcab
I20260812 06:27:33.379031 1998 ts_tablet_manager.cc:1939] T d70d02ad775b4f32b6d8d2d8a759fcab P 0d504fffd7e04269865d2c0d1b33c5cc: Deleting consensus metadata
I20260812 06:27:33.379407 929 catalog_manager.cc:4841] TS 0d504fffd7e04269865d2c0d1b33c5cc (127.30.15.66:36489): tablet d70d02ad775b4f32b6d8d2d8a759fcab (table test-table [id=d0e504559b0d42c58da83ff0aade1e6e]) successfully deleted
I20260812 06:27:33.411144 928 catalog_manager.cc:4841] TS 58b4936cefbb47b09f98d25260f7752c (127.30.15.67:40991): tablet d70d02ad775b4f32b6d8d2d8a759fcab (table test-table [id=d0e504559b0d42c58da83ff0aade1e6e]) successfully deleted
W20260812 06:27:33.415370 934 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:45757 (error 108)
I20260812 06:27:33.415558 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 1367
I20260812 06:27:33.418659 1949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.418485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:45757 (local address 127.0.0.1:55266)
0812 06:27:33.418561 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:33.418617 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:45757: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 06:27:33.418825 934 catalog_manager.cc:4584] TS a67f21cbf4c74079a599237fa40cefef (127.30.15.65:45757): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d70d02ad775b4f32b6d8d2d8a759fcab: Network error: Client connection negotiation failed: client connection to 127.30.15.65:45757: connect: Connection refused (error 111)
I20260812 06:27:33.439128 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 1659
I20260812 06:27:33.452736 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 907
2026-08-12T06:27:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2226 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T06:27:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:33Z Disabled control of system clock
I20260812 06:27:33.488473 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:39329
--webserver_interface=127.30.15.126
--webserver_port=0
--builtin_ntp_servers=127.30.15.84:41801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:39329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:27:33.568492 2011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:33.568679 2011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:33.568696 2011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:33.569731 2011 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:33.569763 2011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:33.569774 2011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:33.569785 2011 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:33.569799 2011 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:33.571030 2011 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:39329
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:39329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:33.571213 2011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:33.571465 2011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:33.575865 2020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:33.575878 2019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:33.575940 2011 server_base.cc:1034] running on GCE node
W20260812 06:27:33.575878 2023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:33.576270 2011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:33.576537 2011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:33.577674 2011 hybrid_clock.cc:648] HybridClock initialized: now 1786516053577660 us; error 29 us; skew 500 ppm
I20260812 06:27:33.581408 2011 webserver.cc:460] Webserver started at http://127.30.15.126:39689/ using document root <none> and password file <none>
I20260812 06:27:33.581604 2011 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:33.581651 2011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:33.581775 2011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:33.582748 2011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "42f2a1271450405daf80e747b07e1cdf"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "4db9c57f5abef2b7d9b03ccccb14ff61"
server_key_iv: "6f72d891ee1c8238fc03c4d568dca491"
server_key_version: "encryptionkey@0"
I20260812 06:27:33.583073 2011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "42f2a1271450405daf80e747b07e1cdf"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "4db9c57f5abef2b7d9b03ccccb14ff61"
server_key_iv: "6f72d891ee1c8238fc03c4d568dca491"
server_key_version: "encryptionkey@0"
I20260812 06:27:33.584256 2011 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:27:33.584916 2031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.585071 2011 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:33.585153 2011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "42f2a1271450405daf80e747b07e1cdf"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "4db9c57f5abef2b7d9b03ccccb14ff61"
server_key_iv: "6f72d891ee1c8238fc03c4d568dca491"
server_key_version: "encryptionkey@0"
I20260812 06:27:33.585220 2011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:33.600864 2011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:33.601111 2011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:33.601228 2011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:33.604796 2011 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:39329
I20260812 06:27:33.604835 2141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:39329 every 8 connection(s)
I20260812 06:27:33.605098 2011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:33.605965 2144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:33.608039 2144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf: Bootstrap starting.
I20260812 06:27:33.608553 2144 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:33.608780 2144 log.cc:824] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:33.609392 2144 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf: No bootstrap required, opened a new log
I20260812 06:27:33.610878 2144 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f2a1271450405daf80e747b07e1cdf" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39329 } }
I20260812 06:27:33.610999 2144 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:33.611029 2144 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42f2a1271450405daf80e747b07e1cdf, State: Initialized, Role: FOLLOWER
I20260812 06:27:33.611133 2144 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f2a1271450405daf80e747b07e1cdf" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39329 } }
I20260812 06:27:33.611182 2144 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:33.611202 2144 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:33.611229 2144 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:33.611696 2144 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f2a1271450405daf80e747b07e1cdf" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39329 } }
I20260812 06:27:33.611779 2144 leader_election.cc:302] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42f2a1271450405daf80e747b07e1cdf; no voters:
I20260812 06:27:33.611905 2144 leader_election.cc:288] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:33.611961 2150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:33.612112 2150 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [term 1 LEADER]: Becoming Leader. State: Replica: 42f2a1271450405daf80e747b07e1cdf, State: Running, Role: LEADER
I20260812 06:27:33.612121 2144 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:33.612226 2150 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f2a1271450405daf80e747b07e1cdf" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39329 } }
I20260812 06:27:33.612620 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 2011
I20260812 06:27:33.612623 2156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42f2a1271450405daf80e747b07e1cdf. Latest consensus state: current_term: 1 leader_uuid: "42f2a1271450405daf80e747b07e1cdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f2a1271450405daf80e747b07e1cdf" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39329 } } }
I20260812 06:27:33.612686 2155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42f2a1271450405daf80e747b07e1cdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42f2a1271450405daf80e747b07e1cdf" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39329 } } }
I20260812 06:27:33.612726 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:33.612699 2156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:33.612753 2155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:33.612936 30781 external_mini_cluster.cc:1428] Setting key 6793ef557094d89df39a16e6e13ed54b
I20260812 06:27:33.613265 2171 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:33.614008 2171 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:33.615620 2171 catalog_manager.cc:1347] Generated new cluster ID: f29038b9d5144afd80358e8f922b2743
I20260812 06:27:33.615672 2171 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:33.619007 2184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.613341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49862 (local address 127.30.15.126:39329)
0812 06:27:33.613759 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:33.613768 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:33.613802 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:27:33.613909 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:33.613915 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:33.613978 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:33.614119 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:33.614348 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.615873 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.616968 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.617589 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.617711 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.618234 (+ 523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:33.618238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:33.618238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:33.618426 (+ 188us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:33.618466 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:33.618482 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:33.618563 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:33.618724 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 06:27:33.618803 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":153,"threads_started":1}
I20260812 06:27:33.649032 2171 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:33.649502 2171 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:33.652837 2171 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf: Generated new TSK 0
I20260812 06:27:33.652994 2171 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:33.655443 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39329
--builtin_ntp_servers=127.30.15.84:41801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:27:33.738073 2192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:33.738260 2192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:33.738278 2192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:33.739416 2192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:33.739452 2192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:33.739480 2192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:27:33.740830 2192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:33.741042 2192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:33.741300 2192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:33.745955 2203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:33.745992 2192 server_base.cc:1034] running on GCE node
W20260812 06:27:33.745960 2199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:33.745995 2200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:33.746325 2192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:33.746541 2192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:33.747677 2192 hybrid_clock.cc:648] HybridClock initialized: now 1786516053747664 us; error 23 us; skew 500 ppm
I20260812 06:27:33.748754 2192 webserver.cc:460] Webserver started at http://127.30.15.65:40189/ using document root <none> and password file <none>
I20260812 06:27:33.748955 2192 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:33.749002 2192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:33.749131 2192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:33.750110 2192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "a0b43c0f8c53443e83ad7c83d5c46642"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "abf1df3889c8a43caaeabe7ac008250f"
server_key_iv: "8b4ad0458ea6656fadf00a6162ad54df"
server_key_version: "encryptionkey@0"
I20260812 06:27:33.750433 2192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "a0b43c0f8c53443e83ad7c83d5c46642"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "abf1df3889c8a43caaeabe7ac008250f"
server_key_iv: "8b4ad0458ea6656fadf00a6162ad54df"
server_key_version: "encryptionkey@0"
I20260812 06:27:33.751641 2192 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:27:33.752275 2214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.752426 2192 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:33.752508 2192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "a0b43c0f8c53443e83ad7c83d5c46642"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "abf1df3889c8a43caaeabe7ac008250f"
server_key_iv: "8b4ad0458ea6656fadf00a6162ad54df"
server_key_version: "encryptionkey@0"
I20260812 06:27:33.752569 2192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:33.762600 2192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:33.762835 2192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:33.762952 2192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:33.763152 2192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:33.763466 2192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:33.763499 2192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.763526 2192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:33.763542 2192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.768958 2192 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:34717
I20260812 06:27:33.769021 2434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:34717 every 8 connection(s)
I20260812 06:27:33.769282 2192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:27:33.771180 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 2192
I20260812 06:27:33.771323 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:27:33.771538 30781 external_mini_cluster.cc:1428] Setting key 81dbf512a3e28e1680c09450ea220f25
I20260812 06:27:33.772493 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39329
--builtin_ntp_servers=127.30.15.84:41801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:27:33.774578 2184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.769926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:58017 (local address 127.30.15.126:39329)
0812 06:27:33.769992 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:33.769994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:33.770196 (+ 202us) server_negotiation.cc:407] Connection header received
0812 06:27:33.770604 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:33.770605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:33.770615 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:33.770661 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:33.771414 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.772026 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.773296 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.773486 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.773539 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.774324 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:33.774326 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:33.774326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:33.774331 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:33.774348 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:33.774353 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:33.774403 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:33.774463 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 06:27:33.774494 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260812 06:27:33.774708 2439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.769895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39329 (local address 127.30.15.65:58017)
0812 06:27:33.770086 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:33.770122 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:33.770535 (+ 413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:33.770716 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:33.770719 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:33.770727 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:33.771316 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.771323 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.772108 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.772109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.773212 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.773216 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.773569 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.773570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.773708 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.774169 (+ 461us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:27:33.774169 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:33.774206 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:27:33.774233 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:33.774403 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:33.774406 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:33.774408 (+ 2us) client_negotiation.cc:769] Sending connection context
0812 06:27:33.774453 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:27:33.774534 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":74,"threads_started":1}
I20260812 06:27:33.775130 2437 heartbeater.cc:347] Connected to a master server at 127.30.15.126:39329
I20260812 06:27:33.775209 2437 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:33.775394 2437 heartbeater.cc:511] Master 127.30.15.126:39329 requested a full tablet report, sending...
I20260812 06:27:33.775866 2063 ts_manager.cc:194] Registered new tserver with Master: a0b43c0f8c53443e83ad7c83d5c46642 (127.30.15.65:34717)
I20260812 06:27:33.776446 2063 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.15.65:58017
W20260812 06:27:33.853504 2440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:33.853699 2440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:33.853727 2440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:33.854842 2440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:33.854879 2440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:33.854911 2440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:27:33.856274 2440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:33.856491 2440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:33.856758 2440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:33.861306 2453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:33.861353 2454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:33.861480 2440 server_base.cc:1034] running on GCE node
W20260812 06:27:33.861317 2459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:33.861781 2440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:33.862004 2440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:33.863150 2440 hybrid_clock.cc:648] HybridClock initialized: now 1786516053863134 us; error 28 us; skew 500 ppm
I20260812 06:27:33.864348 2440 webserver.cc:460] Webserver started at http://127.30.15.66:38387/ using document root <none> and password file <none>
I20260812 06:27:33.864557 2440 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:33.864604 2440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:33.864725 2440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:33.865680 2440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "1350f20950fb46c290842f3d6ddf2084"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "6ba0a0f7d0ca802c4b87540639b7c947"
server_key_iv: "7f041d1b206ad6f4669ba1611826e9b9"
server_key_version: "encryptionkey@0"
I20260812 06:27:33.865993 2440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "1350f20950fb46c290842f3d6ddf2084"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "6ba0a0f7d0ca802c4b87540639b7c947"
server_key_iv: "7f041d1b206ad6f4669ba1611826e9b9"
server_key_version: "encryptionkey@0"
I20260812 06:27:33.867138 2440 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:27:33.867822 2473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.867978 2440 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.868065 2440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "1350f20950fb46c290842f3d6ddf2084"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "6ba0a0f7d0ca802c4b87540639b7c947"
server_key_iv: "7f041d1b206ad6f4669ba1611826e9b9"
server_key_version: "encryptionkey@0"
I20260812 06:27:33.868130 2440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:33.891938 2440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:33.892184 2440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:33.892302 2440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:33.892483 2440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:33.892771 2440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:33.892804 2440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.892830 2440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:33.892848 2440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:33.898252 2440 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:43693
I20260812 06:27:33.898312 2692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:43693 every 8 connection(s)
I20260812 06:27:33.898582 2440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:27:33.903383 2184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.899190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:48601 (local address 127.30.15.126:39329)
0812 06:27:33.899232 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:33.899234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:33.899469 (+ 235us) server_negotiation.cc:407] Connection header received
0812 06:27:33.899951 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:33.899952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:33.899964 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:33.900019 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:33.900671 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.901165 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.902125 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.902317 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.902371 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.903100 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:33.903102 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:33.903102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:33.903107 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:33.903123 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:33.903127 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:33.903169 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:33.903249 (+ 80us) server_negotiation.cc:299] Negotiation successful
0812 06:27:33.903299 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:27:33.903564 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:33.899168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39329 (local address 127.30.15.66:48601)
0812 06:27:33.899360 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:33.899390 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:33.899848 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:33.900101 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:33.900105 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:33.900115 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:33.900582 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.900587 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.901256 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.901257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.902039 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:33.902041 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:33.902395 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:33.902396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:33.902520 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:33.902973 (+ 453us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:27:33.902973 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:33.902999 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:27:33.903020 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:33.903178 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:33.903183 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:33.903186 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:27:33.903245 (+ 59us) client_negotiation.cc:240] Negotiation successful
0812 06:27:33.903373 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":102,"threads_started":1}
I20260812 06:27:33.903956 2693 heartbeater.cc:347] Connected to a master server at 127.30.15.126:39329
I20260812 06:27:33.904050 2693 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:33.904222 2693 heartbeater.cc:511] Master 127.30.15.126:39329 requested a full tablet report, sending...
I20260812 06:27:33.904525 2063 ts_manager.cc:194] Registered new tserver with Master: 1350f20950fb46c290842f3d6ddf2084 (127.30.15.66:43693)
I20260812 06:27:33.904879 2063 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.15.66:48601
I20260812 06:27:33.908150 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 2440
I20260812 06:27:33.908258 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:27:33.908434 30781 external_mini_cluster.cc:1428] Setting key 418a8addfae0aa0661ad7e2c139de36d
I20260812 06:27:33.909236 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39329
--builtin_ntp_servers=127.30.15.84:41801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:27:33.990130 2698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:33.990307 2698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:33.990326 2698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:33.991451 2698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:33.991488 2698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:33.991511 2698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:27:33.992830 2698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:41801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:39329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:33.993044 2698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:33.993306 2698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:33.998178 2704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:33.998203 2706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:33.998215 2712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:33.998293 2698 server_base.cc:1034] running on GCE node
I20260812 06:27:33.998579 2698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:33.998799 2698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:33.999939 2698 hybrid_clock.cc:648] HybridClock initialized: now 1786516053999930 us; error 27 us; skew 500 ppm
I20260812 06:27:34.001085 2698 webserver.cc:460] Webserver started at http://127.30.15.67:42831/ using document root <none> and password file <none>
I20260812 06:27:34.001304 2698 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:34.001346 2698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:34.001483 2698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:34.002518 2698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "ac69daf5f34f44c6958ef0e425607c96"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "90b880eb9be8057bb0b3c1b2d522b99a"
server_key_iv: "60142b07dccb31ec3f5179cf7cacb214"
server_key_version: "encryptionkey@0"
I20260812 06:27:34.002846 2698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "ac69daf5f34f44c6958ef0e425607c96"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "90b880eb9be8057bb0b3c1b2d522b99a"
server_key_iv: "60142b07dccb31ec3f5179cf7cacb214"
server_key_version: "encryptionkey@0"
I20260812 06:27:34.004118 2698 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:27:34.004756 2727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:34.004904 2698 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:27:34.004979 2698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "ac69daf5f34f44c6958ef0e425607c96"
format_stamp: "Formatted at 2026-08-12 06:27:33 on dist-test-slave-gjrz"
server_key: "90b880eb9be8057bb0b3c1b2d522b99a"
server_key_iv: "60142b07dccb31ec3f5179cf7cacb214"
server_key_version: "encryptionkey@0"
I20260812 06:27:34.005033 2698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:34.033057 2698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:34.033341 2698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:34.033464 2698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:34.033689 2698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:34.034013 2698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:34.034061 2698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:34.034092 2698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:34.034117 2698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:34.039812 2698 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:36655
I20260812 06:27:34.039891 2945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:36655 every 8 connection(s)
I20260812 06:27:34.040187 2698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:27:34.044550 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 2698
I20260812 06:27:34.044651 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:27:34.044863 30781 external_mini_cluster.cc:1428] Setting key ba92aac1b1c22f519a99eb98ff0893b0
I20260812 06:27:34.045413 2184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.040898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:34949 (local address 127.30.15.126:39329)
0812 06:27:34.040944 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:34.040946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:34.041193 (+ 247us) server_negotiation.cc:407] Connection header received
0812 06:27:34.041710 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:34.041712 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:34.041725 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:34.041779 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:34.042469 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.042964 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.044010 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.044209 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.044267 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.045159 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:34.045160 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:34.045161 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:34.045165 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:34.045181 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:34.045186 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:34.045228 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:34.045302 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 06:27:34.045336 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:27:34.045614 2951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.040859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:39329 (local address 127.30.15.67:34949)
0812 06:27:34.041073 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:34.041107 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:34.041608 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:34.041862 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:34.041865 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:34.041873 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:34.042376 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:34.042381 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.043086 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.043087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:34.043922 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:34.043925 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.044287 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.044288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:34.044432 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.045022 (+ 590us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:27:34.045022 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:34.045058 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:27:34.045081 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:34.045237 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:34.045242 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:34.045245 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:27:34.045306 (+ 61us) client_negotiation.cc:240] Negotiation successful
0812 06:27:34.045407 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":103,"threads_started":1}
I20260812 06:27:34.046032 2946 heartbeater.cc:347] Connected to a master server at 127.30.15.126:39329
I20260812 06:27:34.046123 2946 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:34.046298 2946 heartbeater.cc:511] Master 127.30.15.126:39329 requested a full tablet report, sending...
I20260812 06:27:34.046648 2063 ts_manager.cc:194] Registered new tserver with Master: ac69daf5f34f44c6958ef0e425607c96 (127.30.15.67:36655)
I20260812 06:27:34.047003 2063 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.15.67:34949
I20260812 06:27:34.056600 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:27:34.060480 2184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.057891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49878 (local address 127.30.15.126:39329)
0812 06:27:34.057993 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:34.057995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:34.058052 (+ 57us) server_negotiation.cc:407] Connection header received
0812 06:27:34.058113 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:34.058114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:34.058124 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:34.058169 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:34.058346 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.058800 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.059516 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.059687 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.059729 (+ 42us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.060269 (+ 540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:34.060271 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:34.060271 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:34.060275 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:34.060287 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:34.060291 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:34.060358 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:34.060398 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 06:27:34.060407 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 06:27:34.061997 2063 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:27:34.063522 2063 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:27:34.069386 2963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.065456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:36655 (local address 127.0.0.1:45432)
0812 06:27:34.065940 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:34.065948 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:34.065993 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:34.066193 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:34.066194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:34.066197 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:34.066244 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:34.066246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.067141 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.067142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:34.068307 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:34.068310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.069144 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.069144 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:34.069201 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.069210 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:27:34.069264 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:27:34.069312 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":1,"spinlock_wait_cycles":768,"thread_start_us":105,"threads_started":1}
I20260812 06:27:34.069408 2970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.065607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45432 (local address 127.30.15.67:36655)
0812 06:27:34.065771 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:34.065776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:34.066007 (+ 231us) server_negotiation.cc:407] Connection header received
0812 06:27:34.066045 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:34.066046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:34.066059 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:34.066129 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:34.066328 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.067064 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.068404 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.069004 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.069037 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.069097 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:34.069305 (+ 208us) server_negotiation.cc:299] Negotiation successful
0812 06:27:34.069340 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":78,"threads_started":1}
I20260812 06:27:34.069691 2967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.065456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:34717 (local address 127.0.0.1:53626)
0812 06:27:34.065743 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:34.065781 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:34.065846 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:34.066169 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:34.066172 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:34.066174 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:34.066244 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:34.066247 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.067578 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.067579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:34.068639 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:34.068641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.069478 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.069479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:34.069555 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.069559 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:34.069585 (+ 26us) client_negotiation.cc:240] Negotiation successful
0812 06:27:34.069622 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":1,"thread_start_us":61,"threads_started":1}
I20260812 06:27:34.069965 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.065472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:43693 (local address 127.0.0.1:57956)
0812 06:27:34.066045 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:34.066051 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:34.066085 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:34.066386 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:34.066387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:34.066388 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:34.066419 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:34.066420 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.067655 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.067656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:34.068465 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:34.068467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.069406 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.069407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:34.069810 (+ 403us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.069815 (+ 5us) client_negotiation.cc:769] Sending connection context
0812 06:27:34.069860 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:27:34.069895 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":109,"threads_started":1}
I20260812 06:27:34.070154 2972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.065774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53626 (local address 127.30.15.65:34717)
0812 06:27:34.065958 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:34.065961 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:34.065971 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:27:34.066012 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:34.066014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:34.066030 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:34.066160 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:34.066337 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.067476 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.068718 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.069391 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.069848 (+ 457us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.069942 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:34.069967 (+ 25us) server_negotiation.cc:299] Negotiation successful
0812 06:27:34.070001 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":92,"threads_started":1}
I20260812 06:27:34.070195 2971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.065738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57956 (local address 127.30.15.66:43693)
0812 06:27:34.065897 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:34.065901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:34.066111 (+ 210us) server_negotiation.cc:407] Connection header received
0812 06:27:34.066160 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:34.066162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:34.066178 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:34.066315 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:34.066492 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.067579 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.068538 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.069219 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.069287 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.069367 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:34.070078 (+ 711us) server_negotiation.cc:299] Negotiation successful
0812 06:27:34.070121 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":97,"threads_started":1}
I20260812 06:27:34.070115 2827 tablet_service.cc:1467] Processing CreateTablet for tablet e52099649e3a4216a066cc4ee992abc4 (DEFAULT_TABLE table=test-table [id=a03a463c7e12406fb0db8a9d1f8f4016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:34.070500 2827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e52099649e3a4216a066cc4ee992abc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:34.070784 2294 tablet_service.cc:1467] Processing CreateTablet for tablet e52099649e3a4216a066cc4ee992abc4 (DEFAULT_TABLE table=test-table [id=a03a463c7e12406fb0db8a9d1f8f4016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:34.070835 2567 tablet_service.cc:1467] Processing CreateTablet for tablet e52099649e3a4216a066cc4ee992abc4 (DEFAULT_TABLE table=test-table [id=a03a463c7e12406fb0db8a9d1f8f4016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:34.071048 2294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e52099649e3a4216a066cc4ee992abc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:34.071179 2567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e52099649e3a4216a066cc4ee992abc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:34.073698 2973 tablet_bootstrap.cc:492] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642: Bootstrap starting.
I20260812 06:27:34.073760 2978 tablet_bootstrap.cc:492] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96: Bootstrap starting.
I20260812 06:27:34.074247 2979 tablet_bootstrap.cc:492] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084: Bootstrap starting.
I20260812 06:27:34.074362 2973 tablet_bootstrap.cc:654] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:34.074361 2978 tablet_bootstrap.cc:654] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:34.074678 2978 log.cc:824] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:34.074687 2973 log.cc:824] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:34.074844 2979 tablet_bootstrap.cc:654] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:34.075150 2979 log.cc:824] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:34.075507 2978 tablet_bootstrap.cc:492] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96: No bootstrap required, opened a new log
I20260812 06:27:34.075582 2978 ts_tablet_manager.cc:1397] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:27:34.075758 2973 tablet_bootstrap.cc:492] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642: No bootstrap required, opened a new log
I20260812 06:27:34.075822 2973 ts_tablet_manager.cc:1397] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 06:27:34.078151 2973 raft_consensus.cc:348] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b43c0f8c53443e83ad7c83d5c46642" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34717 } } peers { permanent_uuid: "ac69daf5f34f44c6958ef0e425607c96" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 36655 } } peers { permanent_uuid: "1350f20950fb46c290842f3d6ddf2084" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 43693 } }
I20260812 06:27:34.078150 2978 raft_consensus.cc:348] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b43c0f8c53443e83ad7c83d5c46642" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34717 } } peers { permanent_uuid: "ac69daf5f34f44c6958ef0e425607c96" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 36655 } } peers { permanent_uuid: "1350f20950fb46c290842f3d6ddf2084" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 43693 } }
I20260812 06:27:34.078313 2978 raft_consensus.cc:374] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:34.078313 2973 raft_consensus.cc:374] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:34.078349 2978 raft_consensus.cc:729] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac69daf5f34f44c6958ef0e425607c96, State: Initialized, Role: FOLLOWER
I20260812 06:27:34.078349 2973 raft_consensus.cc:729] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0b43c0f8c53443e83ad7c83d5c46642, State: Initialized, Role: FOLLOWER
I20260812 06:27:34.078465 2978 consensus_queue.cc:260] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b43c0f8c53443e83ad7c83d5c46642" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34717 } } peers { permanent_uuid: "ac69daf5f34f44c6958ef0e425607c96" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 36655 } } peers { permanent_uuid: "1350f20950fb46c290842f3d6ddf2084" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 43693 } }
I20260812 06:27:34.078465 2973 consensus_queue.cc:260] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b43c0f8c53443e83ad7c83d5c46642" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34717 } } peers { permanent_uuid: "ac69daf5f34f44c6958ef0e425607c96" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 36655 } } peers { permanent_uuid: "1350f20950fb46c290842f3d6ddf2084" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 43693 } }
I20260812 06:27:34.078720 2973 ts_tablet_manager.cc:1428] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:27:34.078720 2978 ts_tablet_manager.cc:1428] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 06:27:34.078768 2437 heartbeater.cc:503] Master 127.30.15.126:39329 was elected leader, sending a full tablet report...
I20260812 06:27:34.078855 2946 heartbeater.cc:503] Master 127.30.15.126:39329 was elected leader, sending a full tablet report...
I20260812 06:27:34.079319 2979 tablet_bootstrap.cc:492] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084: No bootstrap required, opened a new log
I20260812 06:27:34.079389 2979 ts_tablet_manager.cc:1397] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260812 06:27:34.081293 2979 raft_consensus.cc:348] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b43c0f8c53443e83ad7c83d5c46642" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34717 } } peers { permanent_uuid: "ac69daf5f34f44c6958ef0e425607c96" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 36655 } } peers { permanent_uuid: "1350f20950fb46c290842f3d6ddf2084" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 43693 } }
I20260812 06:27:34.081410 2979 raft_consensus.cc:374] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:34.081441 2979 raft_consensus.cc:729] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1350f20950fb46c290842f3d6ddf2084, State: Initialized, Role: FOLLOWER
I20260812 06:27:34.081547 2979 consensus_queue.cc:260] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b43c0f8c53443e83ad7c83d5c46642" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34717 } } peers { permanent_uuid: "ac69daf5f34f44c6958ef0e425607c96" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 36655 } } peers { permanent_uuid: "1350f20950fb46c290842f3d6ddf2084" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 43693 } }
I20260812 06:27:34.081758 2979 ts_tablet_manager.cc:1428] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 06:27:34.081837 2693 heartbeater.cc:503] Master 127.30.15.126:39329 was elected leader, sending a full tablet report...
W20260812 06:27:34.149124 2694 tablet.cc:2369] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:27:34.269932 2438 tablet.cc:2369] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 06:27:34.290717 2950 tablet.cc:2369] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:27:34.327221 2989 raft_consensus.cc:482] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:27:34.327363 2989 raft_consensus.cc:504] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b43c0f8c53443e83ad7c83d5c46642" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34717 } } peers { permanent_uuid: "ac69daf5f34f44c6958ef0e425607c96" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 36655 } } peers { permanent_uuid: "1350f20950fb46c290842f3d6ddf2084" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 43693 } }
I20260812 06:27:34.327744 2989 leader_election.cc:288] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0b43c0f8c53443e83ad7c83d5c46642 (127.30.15.65:34717), ac69daf5f34f44c6958ef0e425607c96 (127.30.15.67:36655)
I20260812 06:27:34.330382 2970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.328009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:56279 (local address 127.30.15.67:36655)
0812 06:27:34.328056 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:34.328058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:34.328066 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:27:34.328098 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:34.328099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:34.328108 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:34.328154 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:34.328304 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.328796 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.329713 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.330076 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.330139 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.330149 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:34.330282 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 06:27:34.330322 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:27:34.330381 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.327919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:36655 (local address 127.30.15.66:56279)
0812 06:27:34.327978 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:34.327991 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:34.328032 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:34.328172 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:34.328173 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:34.328175 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:34.328243 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:34.328245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.328877 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.328878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:34.329620 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:34.329622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.330157 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.330158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:34.330219 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.330223 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:34.330268 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:27:34.330308 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 06:27:34.330467 2972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.327994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:59795 (local address 127.30.15.65:34717)
0812 06:27:34.328042 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:34.328044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:34.328183 (+ 139us) server_negotiation.cc:407] Connection header received
0812 06:27:34.328230 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:34.328231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:34.328243 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:34.328285 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:34.328437 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.328892 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.329798 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.330147 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.330208 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.330216 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:34.330362 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 06:27:34.330400 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:27:34.330678 2991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.327941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:34717 (local address 127.30.15.66:59795)
0812 06:27:34.328111 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:34.328120 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:34.328178 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:34.328301 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:34.328302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:34.328304 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:34.328371 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:34.328373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.328975 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.328976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:34.329707 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:34.329709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.330228 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.330230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:34.330297 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.330300 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:27:34.330345 (+ 45us) client_negotiation.cc:240] Negotiation successful
0812 06:27:34.330381 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":104,"threads_started":1}
I20260812 06:27:34.330736 2857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e52099649e3a4216a066cc4ee992abc4" candidate_uuid: "1350f20950fb46c290842f3d6ddf2084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac69daf5f34f44c6958ef0e425607c96" is_pre_election: true
I20260812 06:27:34.330889 2857 raft_consensus.cc:2454] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1350f20950fb46c290842f3d6ddf2084 in term 0.
I20260812 06:27:34.331012 2344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e52099649e3a4216a066cc4ee992abc4" candidate_uuid: "1350f20950fb46c290842f3d6ddf2084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0b43c0f8c53443e83ad7c83d5c46642" is_pre_election: true
I20260812 06:27:34.331121 2475 leader_election.cc:302] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1350f20950fb46c290842f3d6ddf2084, ac69daf5f34f44c6958ef0e425607c96; no voters:
I20260812 06:27:34.331171 2344 raft_consensus.cc:2454] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1350f20950fb46c290842f3d6ddf2084 in term 0.
I20260812 06:27:34.331256 2989 raft_consensus.cc:2781] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:27:34.331364 2989 raft_consensus.cc:482] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:27:34.331398 2989 raft_consensus.cc:3037] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:34.332082 2989 raft_consensus.cc:504] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b43c0f8c53443e83ad7c83d5c46642" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34717 } } peers { permanent_uuid: "ac69daf5f34f44c6958ef0e425607c96" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 36655 } } peers { permanent_uuid: "1350f20950fb46c290842f3d6ddf2084" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 43693 } }
I20260812 06:27:34.332188 2989 leader_election.cc:288] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [CANDIDATE]: Term 1 election: Requested vote from peers a0b43c0f8c53443e83ad7c83d5c46642 (127.30.15.65:34717), ac69daf5f34f44c6958ef0e425607c96 (127.30.15.67:36655)
I20260812 06:27:34.332332 2857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e52099649e3a4216a066cc4ee992abc4" candidate_uuid: "1350f20950fb46c290842f3d6ddf2084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac69daf5f34f44c6958ef0e425607c96"
I20260812 06:27:34.332341 2344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e52099649e3a4216a066cc4ee992abc4" candidate_uuid: "1350f20950fb46c290842f3d6ddf2084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0b43c0f8c53443e83ad7c83d5c46642"
I20260812 06:27:34.332401 2344 raft_consensus.cc:3037] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:34.332408 2857 raft_consensus.cc:3037] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:34.333094 2344 raft_consensus.cc:2454] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1350f20950fb46c290842f3d6ddf2084 in term 1.
I20260812 06:27:34.333217 2857 raft_consensus.cc:2454] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1350f20950fb46c290842f3d6ddf2084 in term 1.
I20260812 06:27:34.333268 2476 leader_election.cc:302] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1350f20950fb46c290842f3d6ddf2084, a0b43c0f8c53443e83ad7c83d5c46642; no voters:
I20260812 06:27:34.333369 2989 raft_consensus.cc:2781] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:34.333510 2989 raft_consensus.cc:686] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 1 LEADER]: Becoming Leader. State: Replica: 1350f20950fb46c290842f3d6ddf2084, State: Running, Role: LEADER
I20260812 06:27:34.333631 2989 consensus_queue.cc:237] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b43c0f8c53443e83ad7c83d5c46642" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34717 } } peers { permanent_uuid: "ac69daf5f34f44c6958ef0e425607c96" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 36655 } } peers { permanent_uuid: "1350f20950fb46c290842f3d6ddf2084" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 43693 } }
I20260812 06:27:34.334427 2061 catalog_manager.cc:5495] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1350f20950fb46c290842f3d6ddf2084 (127.30.15.66). New cstate: current_term: 1 leader_uuid: "1350f20950fb46c290842f3d6ddf2084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0b43c0f8c53443e83ad7c83d5c46642" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac69daf5f34f44c6958ef0e425607c96" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 36655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1350f20950fb46c290842f3d6ddf2084" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 43693 } health_report { overall_health: HEALTHY } } }
I20260812 06:27:34.349207 2971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.347317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57962 (local address 127.30.15.66:43693)
0812 06:27:34.347357 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:34.347358 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:34.347368 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:27:34.347409 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:34.347409 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:34.347424 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:34.347487 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:27:34.347574 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.347994 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.348651 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:34.348820 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:34.348859 (+ 39us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:34.348960 (+ 101us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:27:34.349040 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:27:34.349104 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:34.349134 (+ 30us) server_negotiation.cc:299] Negotiation successful
0812 06:27:34.349143 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:27:34.350742 2344 raft_consensus.cc:1261] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642 [term 1 FOLLOWER]: Refusing update from remote peer 1350f20950fb46c290842f3d6ddf2084: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:27:34.350759 2857 raft_consensus.cc:1261] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96 [term 1 FOLLOWER]: Refusing update from remote peer 1350f20950fb46c290842f3d6ddf2084: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:27:34.351048 2992 consensus_queue.cc:1035] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0b43c0f8c53443e83ad7c83d5c46642" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 34717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:27:34.351167 2989 consensus_queue.cc:1035] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac69daf5f34f44c6958ef0e425607c96" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 36655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:27:34.353296 2998 mvcc.cc:205] Tried to move back new op lower bound from 7317569758618435584 to 7317569758551015424. Current Snapshot: MvccSnapshot[applied={T|T < 7317569758618435584}]
I20260812 06:27:34.353909 3000 mvcc.cc:205] Tried to move back new op lower bound from 7317569758618435584 to 7317569758551015424. Current Snapshot: MvccSnapshot[applied={T|T < 7317569758618435584}]
I20260812 06:27:34.354383 2999 mvcc.cc:205] Tried to move back new op lower bound from 7317569758618435584 to 7317569758551015424. Current Snapshot: MvccSnapshot[applied={T|T < 7317569758618435584 or (T in {7317569758618435584})}]
I20260812 06:27:34.355715 2063 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:27:34.355804 2063 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:27:34.356583 2063 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 42f2a1271450405daf80e747b07e1cdf: Sending DeleteTablet for 3 replicas of tablet e52099649e3a4216a066cc4ee992abc4
I20260812 06:27:34.356945 2294 tablet_service.cc:1514] Processing DeleteTablet for tablet e52099649e3a4216a066cc4ee992abc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:34 UTC) from {username='slave'} at 127.0.0.1:53626
I20260812 06:27:34.356930 2827 tablet_service.cc:1514] Processing DeleteTablet for tablet e52099649e3a4216a066cc4ee992abc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:34 UTC) from {username='slave'} at 127.0.0.1:45432
I20260812 06:27:34.357112 2567 tablet_service.cc:1514] Processing DeleteTablet for tablet e52099649e3a4216a066cc4ee992abc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:34 UTC) from {username='slave'} at 127.0.0.1:57956
I20260812 06:27:34.357196 3022 tablet_replica.cc:330] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96: stopping tablet replica
I20260812 06:27:34.357295 3022 raft_consensus.cc:2229] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:27:34.357319 3021 tablet_replica.cc:330] T e52099649e3a4216a066cc4ee992abc4 P a0b43c0f8c53443e83ad7c83d5c46642: stopping tablet replica
I20260812 06:27:34.357395 3022 raft_consensus.cc:2258] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:34.357494 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 2192
I20260812 06:27:34.407225 3024 tablet_replica.cc:330] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084: stopping tablet replica
I20260812 06:27:34.407411 3024 raft_consensus.cc:2229] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:27:34.407534 3024 raft_consensus.cc:2258] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:34.407670 3022 ts_tablet_manager.cc:1905] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:27:34.408011 3024 ts_tablet_manager.cc:1905] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:27:34.409382 3022 ts_tablet_manager.cc:1918] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:27:34.409464 3022 log.cc:1196] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/e52099649e3a4216a066cc4ee992abc4
I20260812 06:27:34.409703 3022 ts_tablet_manager.cc:1939] T e52099649e3a4216a066cc4ee992abc4 P ac69daf5f34f44c6958ef0e425607c96: Deleting consensus metadata
I20260812 06:27:34.409690 3024 ts_tablet_manager.cc:1918] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:27:34.409755 3024 log.cc:1196] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/e52099649e3a4216a066cc4ee992abc4
I20260812 06:27:34.409981 3024 ts_tablet_manager.cc:1939] T e52099649e3a4216a066cc4ee992abc4 P 1350f20950fb46c290842f3d6ddf2084: Deleting consensus metadata
I20260812 06:27:34.410336 2032 catalog_manager.cc:4841] TS ac69daf5f34f44c6958ef0e425607c96 (127.30.15.67:36655): tablet e52099649e3a4216a066cc4ee992abc4 (table test-table [id=a03a463c7e12406fb0db8a9d1f8f4016]) successfully deleted
I20260812 06:27:34.410364 2037 catalog_manager.cc:4841] TS 1350f20950fb46c290842f3d6ddf2084 (127.30.15.66:43693): tablet e52099649e3a4216a066cc4ee992abc4 (table test-table [id=a03a463c7e12406fb0db8a9d1f8f4016]) successfully deleted
W20260812 06:27:34.412495 2035 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:34717 (error 108)
I20260812 06:27:34.412789 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 2440
I20260812 06:27:34.412962 2964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:34.412837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:34717 (local address 127.0.0.1:53642)
0812 06:27:34.412891 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:34.412930 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:34717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 06:27:34.414892 2035 catalog_manager.cc:4584] TS a0b43c0f8c53443e83ad7c83d5c46642 (127.30.15.65:34717): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e52099649e3a4216a066cc4ee992abc4: Network error: Client connection negotiation failed: client connection to 127.30.15.65:34717: connect: Connection refused (error 111)
I20260812 06:27:34.427496 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 2698
I20260812 06:27:34.440228 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 2011
2026-08-12T06:27:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (985 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:34 dist-test-slave-gjrz krb5kdc[3037](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:34 dist-test-slave-gjrz krb5kdc[3037](info): set up 2 sockets
Aug 12 06:27:34 dist-test-slave-gjrz krb5kdc[3037](info): commencing operation
krb5kdc: starting...
W20260812 06:27:35.634073 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:35 dist-test-slave-gjrz krb5kdc[3037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:27:35.743953 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:34279
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:34279
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:35.823395 3065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:35.823573 3065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:35.823596 3065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:35.824700 3065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:35.824740 3065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:35.824753 3065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:35.824764 3065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:35.824774 3065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:35.826169 3065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:34279
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:34279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:35.826380 3065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:35.826596 3065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:35.831102 3071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:35.831077 3074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:35.831089 3076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:35.831231 3065 server_base.cc:1034] running on GCE node
I20260812 06:27:35.831601 3065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:35.831861 3065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:35.833003 3065 hybrid_clock.cc:648] HybridClock initialized: now 1786516055832983 us; error 34 us; skew 500 ppm
Aug 12 06:27:35 dist-test-slave-gjrz krb5kdc[3037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516055, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:35.835368 3065 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:27:35.835794 3065 webserver.cc:460] Webserver started at http://127.30.15.126:46815/ using document root <none> and password file <none>
I20260812 06:27:35.835992 3065 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:35.836062 3065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:35.836191 3065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:35.837148 3065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "c32880209659417f939f95dd208e589c"
format_stamp: "Formatted at 2026-08-12 06:27:35 on dist-test-slave-gjrz"
server_key: "25d116bfb7dd711fa83ddd7fac7c4101"
server_key_iv: "a01f7cd40c1688e3b64e95adf6a8688b"
server_key_version: "encryptionkey@0"
I20260812 06:27:35.837424 3065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "c32880209659417f939f95dd208e589c"
format_stamp: "Formatted at 2026-08-12 06:27:35 on dist-test-slave-gjrz"
server_key: "25d116bfb7dd711fa83ddd7fac7c4101"
server_key_iv: "a01f7cd40c1688e3b64e95adf6a8688b"
server_key_version: "encryptionkey@0"
I20260812 06:27:35.838614 3065 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:27:35.839298 3085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:35.839473 3065 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:27:35.839548 3065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "c32880209659417f939f95dd208e589c"
format_stamp: "Formatted at 2026-08-12 06:27:35 on dist-test-slave-gjrz"
server_key: "25d116bfb7dd711fa83ddd7fac7c4101"
server_key_iv: "a01f7cd40c1688e3b64e95adf6a8688b"
server_key_version: "encryptionkey@0"
I20260812 06:27:35.839617 3065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:35.850291 3065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:35.851953 3065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:35.852067 3065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:35.855826 3065 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:34279
I20260812 06:27:35.855873 3182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:34279 every 8 connection(s)
I20260812 06:27:35.856187 3065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:35.857023 3184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:35.858043 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 3065
I20260812 06:27:35.858165 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:35.858337 30781 external_mini_cluster.cc:1428] Setting key 0ffb3c959df75b358217f75586566b2b
I20260812 06:27:35.859763 3184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c: Bootstrap starting.
I20260812 06:27:35.860394 3184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:35.860697 3184 log.cc:824] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:35.861454 3184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c: No bootstrap required, opened a new log
I20260812 06:27:35.863611 3184 raft_consensus.cc:348] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32880209659417f939f95dd208e589c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34279 } }
I20260812 06:27:35.863777 3184 raft_consensus.cc:374] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:35.863814 3184 raft_consensus.cc:729] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c32880209659417f939f95dd208e589c, State: Initialized, Role: FOLLOWER
I20260812 06:27:35.863941 3184 consensus_queue.cc:260] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32880209659417f939f95dd208e589c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34279 } }
I20260812 06:27:35.864020 3184 raft_consensus.cc:388] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:35.864053 3184 raft_consensus.cc:482] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:35.864099 3184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:35.864599 3184 raft_consensus.cc:504] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32880209659417f939f95dd208e589c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34279 } }
I20260812 06:27:35.864694 3184 leader_election.cc:302] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c32880209659417f939f95dd208e589c; no voters:
I20260812 06:27:35.864893 3184 leader_election.cc:288] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:35.864941 3190 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:35.865132 3190 raft_consensus.cc:686] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [term 1 LEADER]: Becoming Leader. State: Replica: c32880209659417f939f95dd208e589c, State: Running, Role: LEADER
I20260812 06:27:35.865149 3184 sys_catalog.cc:564] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [sys.catalog]: configured and running, proceeding with master startup.
Aug 12 06:27:35 dist-test-slave-gjrz krb5kdc[3037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:35.865319 3190 consensus_queue.cc:237] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32880209659417f939f95dd208e589c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34279 } }
I20260812 06:27:35.865857 3193 sys_catalog.cc:455] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c32880209659417f939f95dd208e589c. Latest consensus state: current_term: 1 leader_uuid: "c32880209659417f939f95dd208e589c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32880209659417f939f95dd208e589c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34279 } } }
I20260812 06:27:35.865945 3193 sys_catalog.cc:458] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:35.866107 3191 sys_catalog.cc:455] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c32880209659417f939f95dd208e589c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32880209659417f939f95dd208e589c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 34279 } } }
I20260812 06:27:35.866158 3191 sys_catalog.cc:458] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:35.866151 3203 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:35.866808 3203 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:35.868567 3203 catalog_manager.cc:1347] Generated new cluster ID: b7ec51f50e7343d8a021a7ea8603b459
I20260812 06:27:35.868671 3203 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:35.869379 3188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:35.858850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52752 (local address 127.30.15.126:34279)
0812 06:27:35.859057 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:35.859067 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:35.859101 (+ 34us) server_negotiation.cc:407] Connection header received
0812 06:27:35.859691 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:35.859700 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:35.859760 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:35.859906 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:35.860530 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:35.861810 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:35.862580 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:35.863293 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:35.863404 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:35.865886 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:35.865890 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:35.865891 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:35.865941 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:35.867902 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:35.868248 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:35.868252 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:35.868252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:35.868349 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:35.868563 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:35.868564 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:35.868565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:35.868813 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:35.868926 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:35.869059 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 06:27:35.869188 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":104,"threads_started":1}
I20260812 06:27:35.883296 3203 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:35.883950 3203 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:35.887732 3203 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c: Generated new TSK 0
I20260812 06:27:35.887881 3203 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.15.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
Entry for principal kudu/127.30.15.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab.
I20260812 06:27:35.919487 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34279
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:36.025446 3235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:36.025628 3235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:36.025650 3235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:36.026711 3235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:36.026744 3235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:36.026768 3235 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:27:36.028246 3235 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.65.keytab
--principal=kudu/127.30.15.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:36.028430 3235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:36.028605 3235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:36.033241 3251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:36.033260 3244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:36.033260 3247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:36.033504 3235 server_base.cc:1034] running on GCE node
I20260812 06:27:36.033685 3235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:36.033902 3235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:36.035071 3235 hybrid_clock.cc:648] HybridClock initialized: now 1786516056035052 us; error 28 us; skew 500 ppm
Aug 12 06:27:36 dist-test-slave-gjrz krb5kdc[3037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516056, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:36.037575 3235 init.cc:377] Logged in from keytab as kudu/127.30.15.65@KRBTEST.COM (short username kudu)
I20260812 06:27:36.037962 3235 webserver.cc:460] Webserver started at http://127.30.15.65:41377/ using document root <none> and password file <none>
I20260812 06:27:36.038170 3235 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:36.038218 3235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:36.038338 3235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:36.039331 3235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "405145590f6e4b2286c5559059468107"
format_stamp: "Formatted at 2026-08-12 06:27:36 on dist-test-slave-gjrz"
server_key: "3e7faa8f6e44034d580a138b134f95f5"
server_key_iv: "cea530ee5c2c566795e994374d079af1"
server_key_version: "encryptionkey@0"
I20260812 06:27:36.039666 3235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "405145590f6e4b2286c5559059468107"
format_stamp: "Formatted at 2026-08-12 06:27:36 on dist-test-slave-gjrz"
server_key: "3e7faa8f6e44034d580a138b134f95f5"
server_key_iv: "cea530ee5c2c566795e994374d079af1"
server_key_version: "encryptionkey@0"
I20260812 06:27:36.040880 3235 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:27:36.041554 3270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:36.041736 3235 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:27:36.041824 3235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "405145590f6e4b2286c5559059468107"
format_stamp: "Formatted at 2026-08-12 06:27:36 on dist-test-slave-gjrz"
server_key: "3e7faa8f6e44034d580a138b134f95f5"
server_key_iv: "cea530ee5c2c566795e994374d079af1"
server_key_version: "encryptionkey@0"
I20260812 06:27:36.041893 3235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:36.050343 3235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:36.052060 3235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:36.052161 3235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:36.052318 3235 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:36.052559 3235 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:36.052589 3235 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:36.052608 3235 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:36.052624 3235 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:36.058179 3235 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:33719
I20260812 06:27:36.058244 3475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:33719 every 8 connection(s)
I20260812 06:27:36.058511 3235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
Aug 12 06:27:36 dist-test-slave-gjrz krb5kdc[3037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516056, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.65@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:36.064580 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 3235
I20260812 06:27:36.064689 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:27:36.064906 30781 external_mini_cluster.cc:1428] Setting key 145580a5446e2967722039a13965bfdf
I20260812 06:27:36.069134 3188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.059166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:50425 (local address 127.30.15.126:34279)
0812 06:27:36.059225 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:36.059228 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:36.059418 (+ 190us) server_negotiation.cc:407] Connection header received
0812 06:27:36.059917 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:36.059918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:36.059930 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:36.059978 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:36.060864 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.061367 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.062359 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.062575 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.062634 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.064685 (+ 2051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:36.064686 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:36.064687 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:36.064695 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:36.067778 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:36.068225 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:36.068226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:36.068226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:36.068274 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:36.068544 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:36.068544 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:36.068545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:36.068651 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:36.068700 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:36.068998 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 06:27:36.069071 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260812 06:27:36.069335 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.059092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:34279 (local address 127.30.15.65:50425)
0812 06:27:36.059305 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:36.059342 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:36.059818 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:36.060053 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:36.060056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:36.060582 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:36.060770 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.060774 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.061457 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.061459 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.062272 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.062274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.062653 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.062654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.062772 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.063188 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:27:36.063196 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:36.064587 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:36.067855 (+ 3268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:36.067863 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:36.067866 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:36.068151 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:36.068331 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:36.068332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:36.068332 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:36.068473 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:36.068712 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:36.068720 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:36.068873 (+ 153us) client_negotiation.cc:769] Sending connection context
0812 06:27:36.068983 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 06:27:36.069136 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":89,"threads_started":1}
I20260812 06:27:36.069777 3476 heartbeater.cc:347] Connected to a master server at 127.30.15.126:34279
I20260812 06:27:36.069864 3476 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:36.070024 3476 heartbeater.cc:511] Master 127.30.15.126:34279 requested a full tablet report, sending...
I20260812 06:27:36.070519 3121 ts_manager.cc:194] Registered new tserver with Master: 405145590f6e4b2286c5559059468107 (127.30.15.65:33719)
I20260812 06:27:36.071110 3121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.65@KRBTEST.COM'} at 127.30.15.65:50425
WARNING: no policy specified for kudu/127.30.15.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
Entry for principal kudu/127.30.15.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab.
I20260812 06:27:36.088060 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34279
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:36.168831 3485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:36.169026 3485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:36.169049 3485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:36.170111 3485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:36.170143 3485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:36.170167 3485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:27:36.171579 3485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.66.keytab
--principal=kudu/127.30.15.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:36.171753 3485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:36.171953 3485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:36.176586 3503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:36.176635 3497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:36.176596 3496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:36.176822 3485 server_base.cc:1034] running on GCE node
I20260812 06:27:36.177038 3485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:36.177263 3485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:36.178402 3485 hybrid_clock.cc:648] HybridClock initialized: now 1786516056178394 us; error 27 us; skew 500 ppm
Aug 12 06:27:36 dist-test-slave-gjrz krb5kdc[3037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516056, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:36.180788 3485 init.cc:377] Logged in from keytab as kudu/127.30.15.66@KRBTEST.COM (short username kudu)
I20260812 06:27:36.181172 3485 webserver.cc:460] Webserver started at http://127.30.15.66:34805/ using document root <none> and password file <none>
I20260812 06:27:36.181362 3485 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:36.181406 3485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:36.181528 3485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:36.182528 3485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "45f814a0e2b848238073841d79da1fec"
format_stamp: "Formatted at 2026-08-12 06:27:36 on dist-test-slave-gjrz"
server_key: "9f1750e4c9ec206dc2115dfe085bd6b9"
server_key_iv: "2074f1401177dd64d5077740ba641899"
server_key_version: "encryptionkey@0"
I20260812 06:27:36.182842 3485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "45f814a0e2b848238073841d79da1fec"
format_stamp: "Formatted at 2026-08-12 06:27:36 on dist-test-slave-gjrz"
server_key: "9f1750e4c9ec206dc2115dfe085bd6b9"
server_key_iv: "2074f1401177dd64d5077740ba641899"
server_key_version: "encryptionkey@0"
I20260812 06:27:36.184080 3485 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:27:36.184746 3522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:36.184891 3485 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:36.184966 3485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "45f814a0e2b848238073841d79da1fec"
format_stamp: "Formatted at 2026-08-12 06:27:36 on dist-test-slave-gjrz"
server_key: "9f1750e4c9ec206dc2115dfe085bd6b9"
server_key_iv: "2074f1401177dd64d5077740ba641899"
server_key_version: "encryptionkey@0"
I20260812 06:27:36.185034 3485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:36.204195 3485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:36.206121 3485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:36.206239 3485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:36.206437 3485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:36.206725 3485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:36.206763 3485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:36.206789 3485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:36.206805 3485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:36.212303 3485 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:40769
I20260812 06:27:36.212358 3758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:40769 every 8 connection(s)
I20260812 06:27:36.212662 3485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
Aug 12 06:27:36 dist-test-slave-gjrz krb5kdc[3037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516056, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.66@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:36.220880 3188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.213302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:41947 (local address 127.30.15.126:34279)
0812 06:27:36.213361 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:36.213362 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:36.213539 (+ 177us) server_negotiation.cc:407] Connection header received
0812 06:27:36.213974 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:36.213975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:36.213984 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:36.214034 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:36.214870 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.215437 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.216374 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.216575 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.216624 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.218575 (+ 1951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:36.218576 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:36.218577 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:36.218584 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:36.219666 (+ 1082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:36.220035 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:36.220036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:36.220036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:36.220089 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:36.220360 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:36.220362 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:36.220362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:36.220481 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:36.220548 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:36.220752 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 06:27:36.220818 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:27:36.221019 3764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.213254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:34279 (local address 127.30.15.66:41947)
0812 06:27:36.213413 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:36.213453 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:36.213899 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:36.214091 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:36.214094 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:36.214615 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:36.214794 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.214798 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.215519 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.215520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.216300 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.216302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.216664 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.216666 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.216777 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.217193 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:27:36.217201 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:36.218474 (+ 1273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:36.219744 (+ 1270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:36.219750 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:36.219753 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:36.219963 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:36.220165 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:36.220166 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:36.220166 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:36.220289 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:36.220547 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:36.220551 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:36.220657 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 06:27:36.220732 (+ 75us) client_negotiation.cc:240] Negotiation successful
0812 06:27:36.220846 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":68,"threads_started":1}
I20260812 06:27:36.221465 3759 heartbeater.cc:347] Connected to a master server at 127.30.15.126:34279
I20260812 06:27:36.221552 3759 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:36.221685 3759 heartbeater.cc:511] Master 127.30.15.126:34279 requested a full tablet report, sending...
I20260812 06:27:36.222043 3121 ts_manager.cc:194] Registered new tserver with Master: 45f814a0e2b848238073841d79da1fec (127.30.15.66:40769)
I20260812 06:27:36.222386 3121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.66@KRBTEST.COM'} at 127.30.15.66:41947
I20260812 06:27:36.222636 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 3485
I20260812 06:27:36.222740 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:27:36.222911 30781 external_mini_cluster.cc:1428] Setting key b53d7acee3c60a47e83b77d42271fc93
WARNING: no policy specified for kudu/127.30.15.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
Entry for principal kudu/127.30.15.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab.
I20260812 06:27:36.245669 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34279
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:43541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:36.352793 3773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:36.353238 3773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:36.353272 3773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:36.355607 3773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:36.355683 3773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:36.355739 3773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:27:36.358709 3773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:43541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.67.keytab
--principal=kudu/127.30.15.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:34279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:36.359383 3773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:36.359970 3773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:36.369866 3789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:36.370069 3780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:36.369874 3785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:36.369956 3773 server_base.cc:1034] running on GCE node
I20260812 06:27:36.370448 3773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:36.370872 3773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:36.372084 3773 hybrid_clock.cc:648] HybridClock initialized: now 1786516056372047 us; error 69 us; skew 500 ppm
Aug 12 06:27:36 dist-test-slave-gjrz krb5kdc[3037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516056, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:36.376492 3773 init.cc:377] Logged in from keytab as kudu/127.30.15.67@KRBTEST.COM (short username kudu)
I20260812 06:27:36.377190 3773 webserver.cc:460] Webserver started at http://127.30.15.67:42219/ using document root <none> and password file <none>
I20260812 06:27:36.377517 3773 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:36.377626 3773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:36.377843 3773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:36.379580 3773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "0479826fe37f410ea5c04de37f371842"
format_stamp: "Formatted at 2026-08-12 06:27:36 on dist-test-slave-gjrz"
server_key: "368a1c92a298acd2b6ab38c768726e20"
server_key_iv: "465cf3793eb5324b8ecf6bc8ebabb07d"
server_key_version: "encryptionkey@0"
I20260812 06:27:36.380223 3773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "0479826fe37f410ea5c04de37f371842"
format_stamp: "Formatted at 2026-08-12 06:27:36 on dist-test-slave-gjrz"
server_key: "368a1c92a298acd2b6ab38c768726e20"
server_key_iv: "465cf3793eb5324b8ecf6bc8ebabb07d"
server_key_version: "encryptionkey@0"
I20260812 06:27:36.382665 3773 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:27:36.384140 3800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:36.384433 3773 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:27:36.384582 3773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "0479826fe37f410ea5c04de37f371842"
format_stamp: "Formatted at 2026-08-12 06:27:36 on dist-test-slave-gjrz"
server_key: "368a1c92a298acd2b6ab38c768726e20"
server_key_iv: "465cf3793eb5324b8ecf6bc8ebabb07d"
server_key_version: "encryptionkey@0"
I20260812 06:27:36.384671 3773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:36.401922 3773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:36.405721 3773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:36.405934 3773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:36.406328 3773 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:36.406860 3773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:36.406926 3773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:36.406975 3773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:36.407021 3773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:36.417717 3773 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:45301
I20260812 06:27:36.417838 4022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:45301 every 8 connection(s)
I20260812 06:27:36.418314 3773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:27:36.421010 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 3773
I20260812 06:27:36.421187 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:27:36.421439 30781 external_mini_cluster.cc:1428] Setting key 1ca036b888b286f89c8112ed4258440a
Aug 12 06:27:36 dist-test-slave-gjrz krb5kdc[3037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516056, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.67@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:36.434388 3188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.419523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:39983 (local address 127.30.15.126:34279)
0812 06:27:36.419634 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:36.419636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:36.420006 (+ 370us) server_negotiation.cc:407] Connection header received
0812 06:27:36.420991 (+ 985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:36.420993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:36.421039 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:36.421156 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:36.423183 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.424048 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.425861 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.426179 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.426324 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.429775 (+ 3451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:36.429776 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:36.429776 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:36.429792 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:36.432142 (+ 2350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:36.432766 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:36.432767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:36.432768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:36.432863 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:36.433344 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:36.433346 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:36.433346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:36.433577 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:36.433694 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:36.434127 (+ 433us) server_negotiation.cc:299] Negotiation successful
0812 06:27:36.434278 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 06:27:36.434689 4027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.419554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:34279 (local address 127.30.15.67:39983)
0812 06:27:36.419818 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:36.419865 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:36.420800 (+ 935us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:36.421296 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:36.421310 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:36.422578 (+ 1268us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:36.423052 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.423060 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.424224 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.424225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.425719 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.425728 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.426335 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.426336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.426583 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.427367 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:27:36.427386 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:36.429648 (+ 2262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:36.432244 (+ 2596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:36.432257 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:36.432268 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:36.432660 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:36.432962 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:27:36.432962 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:27:36.432962 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:27:36.433191 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:27:36.433681 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:36.433686 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:36.433950 (+ 264us) client_negotiation.cc:769] Sending connection context
0812 06:27:36.434083 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 06:27:36.434361 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":98,"threads_started":1}
I20260812 06:27:36.435506 4025 heartbeater.cc:347] Connected to a master server at 127.30.15.126:34279
I20260812 06:27:36.435676 4025 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:36.436066 4025 heartbeater.cc:511] Master 127.30.15.126:34279 requested a full tablet report, sending...
I20260812 06:27:36.436651 3121 ts_manager.cc:194] Registered new tserver with Master: 0479826fe37f410ea5c04de37f371842 (127.30.15.67:45301)
I20260812 06:27:36.437193 3121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.15.67@KRBTEST.COM'} at 127.30.15.67:39983
I20260812 06:27:36.445250 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:27:36.456104 3188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.447322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52760 (local address 127.30.15.126:34279)
0812 06:27:36.447407 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:36.447411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:36.447568 (+ 157us) server_negotiation.cc:407] Connection header received
0812 06:27:36.447645 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:36.447645 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:36.447662 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:36.447736 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:36.448624 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.449428 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.450625 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.450886 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.450963 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.452763 (+ 1800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:36.452764 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:36.452765 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:36.452770 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:36.454625 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:36.455056 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:36.455057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:36.455057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:36.455122 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:36.455394 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:36.455395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:36.455395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:36.455653 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:36.455763 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:36.455932 (+ 169us) server_negotiation.cc:299] Negotiation successful
0812 06:27:36.456031 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260812 06:27:36.458478 3121 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:27:36.461200 3121 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:27:36.471441 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.465231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:45301 (local address 127.0.0.1:35522)
0812 06:27:36.465514 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:36.465602 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:36.465703 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:36.466473 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:36.466474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:36.466477 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:36.466564 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.466566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.468603 (+ 2037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.468604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.469751 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.469760 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.471008 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.471009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.471104 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.471126 (+ 22us) client_negotiation.cc:769] Sending connection context
0812 06:27:36.471197 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:27:36.471324 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":193,"threads_started":1}
I20260812 06:27:36.472245 4055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.465889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35522 (local address 127.30.15.67:45301)
0812 06:27:36.466238 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:36.466241 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:36.466253 (+ 12us) server_negotiation.cc:407] Connection header received
0812 06:27:36.466288 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:36.466290 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:36.466305 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:36.466524 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:36.466678 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.468405 (+ 1727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.469919 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.470830 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.471920 (+ 1090us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.472040 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:36.472092 (+ 52us) server_negotiation.cc:299] Negotiation successful
0812 06:27:36.472131 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":119,"threads_started":1}
I20260812 06:27:36.472692 4047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.464878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:40769 (local address 127.0.0.1:57800)
0812 06:27:36.465514 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:36.465602 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:36.465716 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:36.466198 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:36.466201 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:36.466204 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:36.466270 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.466272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.468514 (+ 2242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.468515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.470392 (+ 1877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.470394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.472123 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.472124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.472234 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.472238 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:36.472333 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 06:27:36.472406 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":58,"thread_start_us":95,"threads_started":1}
I20260812 06:27:36.472695 4056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.465912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57322 (local address 127.30.15.65:33719)
0812 06:27:36.466130 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:36.466134 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:36.466222 (+ 88us) server_negotiation.cc:407] Connection header received
0812 06:27:36.466394 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:36.466396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:36.466425 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:36.466565 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:36.466874 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.468034 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.470560 (+ 2526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.471817 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.471933 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.472034 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:36.472417 (+ 383us) server_negotiation.cc:299] Negotiation successful
0812 06:27:36.472471 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":117,"threads_started":1}
I20260812 06:27:36.473028 4053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.465604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:33719 (local address 127.0.0.1:57322)
0812 06:27:36.466157 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:36.466167 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:36.466251 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:36.466693 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:36.466694 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:36.466696 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:36.466775 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.466776 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.468250 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.468251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.470391 (+ 2140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.470394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.472121 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.472121 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.472241 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.472245 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:36.472866 (+ 621us) client_negotiation.cc:240] Negotiation successful
0812 06:27:36.472949 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"mutex_wait_us":15,"thread_start_us":98,"threads_started":1}
I20260812 06:27:36.473045 4046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.465082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57800 (local address 127.30.15.66:40769)
0812 06:27:36.465614 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:36.465620 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:36.465880 (+ 260us) server_negotiation.cc:407] Connection header received
0812 06:27:36.465968 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:36.465972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:36.465995 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:36.466060 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:36.466383 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.468350 (+ 1967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.470580 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.471878 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.471998 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.472077 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:36.472838 (+ 761us) server_negotiation.cc:299] Negotiation successful
0812 06:27:36.472936 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":238,"threads_started":1}
I20260812 06:27:36.475502 3616 tablet_service.cc:1467] Processing CreateTablet for tablet 426699912e9a43cfa3c848cd59a81ca3 (DEFAULT_TABLE table=test-table [id=865d40a6a5ea47ee9b5f83d849617866]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:36.475696 3902 tablet_service.cc:1467] Processing CreateTablet for tablet 426699912e9a43cfa3c848cd59a81ca3 (DEFAULT_TABLE table=test-table [id=865d40a6a5ea47ee9b5f83d849617866]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:36.475693 3349 tablet_service.cc:1467] Processing CreateTablet for tablet 426699912e9a43cfa3c848cd59a81ca3 (DEFAULT_TABLE table=test-table [id=865d40a6a5ea47ee9b5f83d849617866]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:36.476174 3616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 426699912e9a43cfa3c848cd59a81ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:36.476332 3349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 426699912e9a43cfa3c848cd59a81ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:36.476332 3902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 426699912e9a43cfa3c848cd59a81ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:36.480867 4059 tablet_bootstrap.cc:492] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec: Bootstrap starting.
I20260812 06:27:36.481928 4059 tablet_bootstrap.cc:654] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:36.482663 4061 tablet_bootstrap.cc:492] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107: Bootstrap starting.
I20260812 06:27:36.483098 4062 tablet_bootstrap.cc:492] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842: Bootstrap starting.
I20260812 06:27:36.483088 4059 log.cc:824] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:36.484462 4062 tablet_bootstrap.cc:654] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:36.484702 4061 tablet_bootstrap.cc:654] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:36.485525 4062 log.cc:824] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:36.485728 4061 log.cc:824] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:36.486703 4059 tablet_bootstrap.cc:492] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec: No bootstrap required, opened a new log
I20260812 06:27:36.486774 4062 tablet_bootstrap.cc:492] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842: No bootstrap required, opened a new log
I20260812 06:27:36.486817 4059 ts_tablet_manager.cc:1397] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260812 06:27:36.486984 4062 ts_tablet_manager.cc:1397] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.004s
I20260812 06:27:36.487257 4061 tablet_bootstrap.cc:492] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107: No bootstrap required, opened a new log
I20260812 06:27:36.487494 4061 ts_tablet_manager.cc:1397] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 06:27:36.489814 4059 raft_consensus.cc:348] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f814a0e2b848238073841d79da1fec" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 40769 } } peers { permanent_uuid: "0479826fe37f410ea5c04de37f371842" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 45301 } } peers { permanent_uuid: "405145590f6e4b2286c5559059468107" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33719 } }
I20260812 06:27:36.490104 4059 raft_consensus.cc:374] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:36.490213 4059 raft_consensus.cc:729] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f814a0e2b848238073841d79da1fec, State: Initialized, Role: FOLLOWER
I20260812 06:27:36.490442 4059 consensus_queue.cc:260] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f814a0e2b848238073841d79da1fec" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 40769 } } peers { permanent_uuid: "0479826fe37f410ea5c04de37f371842" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 45301 } } peers { permanent_uuid: "405145590f6e4b2286c5559059468107" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33719 } }
I20260812 06:27:36.491084 3759 heartbeater.cc:503] Master 127.30.15.126:34279 was elected leader, sending a full tablet report...
I20260812 06:27:36.490931 4062 raft_consensus.cc:348] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f814a0e2b848238073841d79da1fec" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 40769 } } peers { permanent_uuid: "0479826fe37f410ea5c04de37f371842" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 45301 } } peers { permanent_uuid: "405145590f6e4b2286c5559059468107" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33719 } }
I20260812 06:27:36.491098 4059 ts_tablet_manager.cc:1428] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260812 06:27:36.491349 4062 raft_consensus.cc:374] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:36.491504 4062 raft_consensus.cc:729] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0479826fe37f410ea5c04de37f371842, State: Initialized, Role: FOLLOWER
I20260812 06:27:36.491766 4062 consensus_queue.cc:260] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f814a0e2b848238073841d79da1fec" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 40769 } } peers { permanent_uuid: "0479826fe37f410ea5c04de37f371842" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 45301 } } peers { permanent_uuid: "405145590f6e4b2286c5559059468107" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33719 } }
I20260812 06:27:36.491421 4061 raft_consensus.cc:348] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f814a0e2b848238073841d79da1fec" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 40769 } } peers { permanent_uuid: "0479826fe37f410ea5c04de37f371842" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 45301 } } peers { permanent_uuid: "405145590f6e4b2286c5559059468107" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33719 } }
I20260812 06:27:36.491953 4061 raft_consensus.cc:374] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:36.492028 4061 raft_consensus.cc:729] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 405145590f6e4b2286c5559059468107, State: Initialized, Role: FOLLOWER
I20260812 06:27:36.492349 4062 ts_tablet_manager.cc:1428] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260812 06:27:36.492319 4061 consensus_queue.cc:260] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f814a0e2b848238073841d79da1fec" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 40769 } } peers { permanent_uuid: "0479826fe37f410ea5c04de37f371842" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 45301 } } peers { permanent_uuid: "405145590f6e4b2286c5559059468107" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33719 } }
I20260812 06:27:36.492372 4025 heartbeater.cc:503] Master 127.30.15.126:34279 was elected leader, sending a full tablet report...
I20260812 06:27:36.492830 3476 heartbeater.cc:503] Master 127.30.15.126:34279 was elected leader, sending a full tablet report...
I20260812 06:27:36.492866 4061 ts_tablet_manager.cc:1428] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260812 06:27:36.559365 3477 tablet.cc:2369] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:27:36.618448 4069 raft_consensus.cc:482] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:27:36.618639 4069 raft_consensus.cc:504] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f814a0e2b848238073841d79da1fec" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 40769 } } peers { permanent_uuid: "0479826fe37f410ea5c04de37f371842" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 45301 } } peers { permanent_uuid: "405145590f6e4b2286c5559059468107" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33719 } }
I20260812 06:27:36.619379 4069 leader_election.cc:288] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f814a0e2b848238073841d79da1fec (127.30.15.66:40769), 405145590f6e4b2286c5559059468107 (127.30.15.65:33719)
I20260812 06:27:36.623999 4056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.619949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:54035 (local address 127.30.15.65:33719)
0812 06:27:36.620056 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:36.620058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:36.620244 (+ 186us) server_negotiation.cc:407] Connection header received
0812 06:27:36.620318 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:36.620320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:36.620344 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:36.620419 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:36.620696 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.621461 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.622880 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.623516 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.623644 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.623655 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:36.623833 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 06:27:36.623915 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 06:27:36.623971 4027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.619604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:40769 (local address 127.30.15.67:57293)
0812 06:27:36.619671 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:36.619692 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:36.619766 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:36.620130 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:36.620131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:36.620134 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:36.620242 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.620253 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.621435 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.621436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.622572 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.622575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.623531 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.623533 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.623675 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.623679 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:36.623759 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 06:27:36.623825 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260812 06:27:36.624003 4046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.619702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:57293 (local address 127.30.15.66:40769)
0812 06:27:36.619799 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:36.619801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:36.619824 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:27:36.619880 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:36.619881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:36.619904 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:36.620041 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:36.620375 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.621307 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.622717 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.623423 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.623494 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.623512 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:36.623777 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 06:27:36.623847 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 06:27:36.624128 4076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.619852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:33719 (local address 127.30.15.67:54035)
0812 06:27:36.620149 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:36.620171 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:36.620238 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:36.620440 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:36.620441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:36.620443 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:36.620576 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.620578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.621567 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.621568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.622756 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:36.622763 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.623639 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.623641 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:36.623723 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.623727 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:36.623818 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 06:27:36.623886 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":21,"thread_start_us":192,"threads_started":1}
I20260812 06:27:36.624716 3672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "426699912e9a43cfa3c848cd59a81ca3" candidate_uuid: "0479826fe37f410ea5c04de37f371842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f814a0e2b848238073841d79da1fec" is_pre_election: true
I20260812 06:27:36.624711 3383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "426699912e9a43cfa3c848cd59a81ca3" candidate_uuid: "0479826fe37f410ea5c04de37f371842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "405145590f6e4b2286c5559059468107" is_pre_election: true
I20260812 06:27:36.625012 3672 raft_consensus.cc:2454] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0479826fe37f410ea5c04de37f371842 in term 0.
I20260812 06:27:36.625012 3383 raft_consensus.cc:2454] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0479826fe37f410ea5c04de37f371842 in term 0.
I20260812 06:27:36.625375 3805 leader_election.cc:302] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0479826fe37f410ea5c04de37f371842, 45f814a0e2b848238073841d79da1fec; no voters:
I20260812 06:27:36.625559 4069 raft_consensus.cc:2781] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:27:36.625658 4069 raft_consensus.cc:482] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:27:36.625713 4069 raft_consensus.cc:3037] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:36.626873 4069 raft_consensus.cc:504] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f814a0e2b848238073841d79da1fec" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 40769 } } peers { permanent_uuid: "0479826fe37f410ea5c04de37f371842" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 45301 } } peers { permanent_uuid: "405145590f6e4b2286c5559059468107" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33719 } }
I20260812 06:27:36.627053 4069 leader_election.cc:288] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [CANDIDATE]: Term 1 election: Requested vote from peers 45f814a0e2b848238073841d79da1fec (127.30.15.66:40769), 405145590f6e4b2286c5559059468107 (127.30.15.65:33719)
I20260812 06:27:36.627364 3672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "426699912e9a43cfa3c848cd59a81ca3" candidate_uuid: "0479826fe37f410ea5c04de37f371842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f814a0e2b848238073841d79da1fec"
I20260812 06:27:36.627435 3383 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "426699912e9a43cfa3c848cd59a81ca3" candidate_uuid: "0479826fe37f410ea5c04de37f371842" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "405145590f6e4b2286c5559059468107"
I20260812 06:27:36.627498 3672 raft_consensus.cc:3037] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:36.627542 3383 raft_consensus.cc:3037] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:36.628777 3383 raft_consensus.cc:2454] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0479826fe37f410ea5c04de37f371842 in term 1.
I20260812 06:27:36.628893 3672 raft_consensus.cc:2454] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0479826fe37f410ea5c04de37f371842 in term 1.
I20260812 06:27:36.628988 3805 leader_election.cc:302] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0479826fe37f410ea5c04de37f371842, 405145590f6e4b2286c5559059468107; no voters:
I20260812 06:27:36.629109 4069 raft_consensus.cc:2781] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:36.629340 4069 raft_consensus.cc:686] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 1 LEADER]: Becoming Leader. State: Replica: 0479826fe37f410ea5c04de37f371842, State: Running, Role: LEADER
I20260812 06:27:36.629498 4069 consensus_queue.cc:237] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f814a0e2b848238073841d79da1fec" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 40769 } } peers { permanent_uuid: "0479826fe37f410ea5c04de37f371842" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 45301 } } peers { permanent_uuid: "405145590f6e4b2286c5559059468107" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33719 } }
I20260812 06:27:36.630869 3121 catalog_manager.cc:5495] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0479826fe37f410ea5c04de37f371842 (127.30.15.67). New cstate: current_term: 1 leader_uuid: "0479826fe37f410ea5c04de37f371842" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f814a0e2b848238073841d79da1fec" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 40769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0479826fe37f410ea5c04de37f371842" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 45301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "405145590f6e4b2286c5559059468107" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33719 } health_report { overall_health: UNKNOWN } } }
I20260812 06:27:36.659648 4055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.655883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35526 (local address 127.30.15.67:45301)
0812 06:27:36.655973 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:36.655975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:36.655985 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:27:36.656158 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:36.656159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:36.656179 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:36.656274 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:27:36.656498 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.657201 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.658327 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.658617 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.658727 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.658958 (+ 231us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:27:36.659126 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:27:36.659244 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:36.659426 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 06:27:36.659477 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 06:27:36.662683 3672 raft_consensus.cc:1261] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec [term 1 FOLLOWER]: Refusing update from remote peer 0479826fe37f410ea5c04de37f371842: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:27:36.662683 3383 raft_consensus.cc:1261] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107 [term 1 FOLLOWER]: Refusing update from remote peer 0479826fe37f410ea5c04de37f371842: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:27:36.663295 4069 consensus_queue.cc:1035] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f814a0e2b848238073841d79da1fec" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:27:36.663532 4078 consensus_queue.cc:1035] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [LEADER]: Connected to new peer: Peer: permanent_uuid: "405145590f6e4b2286c5559059468107" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 33719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:27:36.668220 4087 mvcc.cc:205] Tried to move back new op lower bound from 7317569768085823488 to 7317569767955554304. Current Snapshot: MvccSnapshot[applied={T|T < 7317569768085823488}]
I20260812 06:27:36.668763 4088 mvcc.cc:205] Tried to move back new op lower bound from 7317569768085823488 to 7317569767955554304. Current Snapshot: MvccSnapshot[applied={T|T < 7317569768085823488}]
I20260812 06:27:36.671499 3117 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:27:36.671669 3117 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:27:36.672868 3117 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c32880209659417f939f95dd208e589c: Sending DeleteTablet for 3 replicas of tablet 426699912e9a43cfa3c848cd59a81ca3
I20260812 06:27:36.673388 3616 tablet_service.cc:1514] Processing DeleteTablet for tablet 426699912e9a43cfa3c848cd59a81ca3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:36 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:57800
I20260812 06:27:36.673471 3902 tablet_service.cc:1514] Processing DeleteTablet for tablet 426699912e9a43cfa3c848cd59a81ca3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:36 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:35522
I20260812 06:27:36.673492 3349 tablet_service.cc:1514] Processing DeleteTablet for tablet 426699912e9a43cfa3c848cd59a81ca3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:36 UTC) from {username='kudu', principal='kudu/127.30.15.126@KRBTEST.COM'} at 127.0.0.1:57322
I20260812 06:27:36.673837 4106 tablet_replica.cc:330] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec: stopping tablet replica
I20260812 06:27:36.673897 4111 tablet_replica.cc:330] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107: stopping tablet replica
I20260812 06:27:36.674103 4111 raft_consensus.cc:2229] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:27:36.674104 4106 raft_consensus.cc:2229] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:27:36.674322 4111 raft_consensus.cc:2258] T 426699912e9a43cfa3c848cd59a81ca3 P 405145590f6e4b2286c5559059468107 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:36.674345 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 3235
I20260812 06:27:36.683435 4107 tablet_replica.cc:330] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842: stopping tablet replica
I20260812 06:27:36.683684 4107 raft_consensus.cc:2229] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:27:36.683866 4107 raft_consensus.cc:2258] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:36.674484 4106 raft_consensus.cc:2258] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:36.685093 4107 ts_tablet_manager.cc:1905] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:27:36.685092 4106 ts_tablet_manager.cc:1905] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:27:36.688097 4106 ts_tablet_manager.cc:1918] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:27:36.688097 4107 ts_tablet_manager.cc:1918] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:27:36.688297 4107 log.cc:1196] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/426699912e9a43cfa3c848cd59a81ca3
I20260812 06:27:36.688367 4106 log.cc:1196] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/426699912e9a43cfa3c848cd59a81ca3
I20260812 06:27:36.688885 4107 ts_tablet_manager.cc:1939] T 426699912e9a43cfa3c848cd59a81ca3 P 0479826fe37f410ea5c04de37f371842: Deleting consensus metadata
I20260812 06:27:36.688894 4106 ts_tablet_manager.cc:1939] T 426699912e9a43cfa3c848cd59a81ca3 P 45f814a0e2b848238073841d79da1fec: Deleting consensus metadata
I20260812 06:27:36.689664 3091 catalog_manager.cc:4841] TS 45f814a0e2b848238073841d79da1fec (127.30.15.66:40769): tablet 426699912e9a43cfa3c848cd59a81ca3 (table test-table [id=865d40a6a5ea47ee9b5f83d849617866]) successfully deleted
I20260812 06:27:36.689826 3091 catalog_manager.cc:4841] TS 0479826fe37f410ea5c04de37f371842 (127.30.15.67:45301): tablet 426699912e9a43cfa3c848cd59a81ca3 (table test-table [id=865d40a6a5ea47ee9b5f83d849617866]) successfully deleted
W20260812 06:27:36.691960 3091 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:33719 (error 108)
I20260812 06:27:36.692373 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 3485
I20260812 06:27:36.696079 4053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.692650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:33719 (local address 127.0.0.1:57338)
0812 06:27:36.695916 (+ 3266us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:36.696008 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:33719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3235}
W20260812 06:27:36.696287 3091 catalog_manager.cc:4584] TS 405145590f6e4b2286c5559059468107 (127.30.15.65:33719): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 426699912e9a43cfa3c848cd59a81ca3: Network error: Client connection negotiation failed: client connection to 127.30.15.65:33719: connect: Connection refused (error 111)
I20260812 06:27:36.705883 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 3773
I20260812 06:27:36.729825 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 3065
2026-08-12T06:27:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2295 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T06:27:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:36Z Disabled control of system clock
I20260812 06:27:36.773881 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:44183
--webserver_interface=127.30.15.126
--webserver_port=0
--builtin_ntp_servers=127.30.15.84:45233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:44183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:27:36.912720 4118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:36.913060 4118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:36.913084 4118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:36.914880 4118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:36.914949 4118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:36.914974 4118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:36.914997 4118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:36.915022 4118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:36.917066 4118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:45233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:44183
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:44183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:36.917405 4118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:36.917851 4118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:36.925235 4127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:36.925297 4132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:36.925297 4128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:36.925661 4118 server_base.cc:1034] running on GCE node
I20260812 06:27:36.926054 4118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:36.926551 4118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:36.927748 4118 hybrid_clock.cc:648] HybridClock initialized: now 1786516056927719 us; error 47 us; skew 500 ppm
I20260812 06:27:36.929759 4118 webserver.cc:460] Webserver started at http://127.30.15.126:45819/ using document root <none> and password file <none>
I20260812 06:27:36.930153 4118 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:36.930261 4118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:36.930496 4118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:36.932236 4118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "cc2c6d99b23d4ca7bac0325398f62868"
format_stamp: "Formatted at 2026-08-12 06:27:36 on dist-test-slave-gjrz"
server_key: "956e0efc2cb8b90b8fdf7d75e5f4be90"
server_key_iv: "37d1f72f988392cd7bae04ec2b85d80b"
server_key_version: "encryptionkey@0"
I20260812 06:27:36.932780 4118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "cc2c6d99b23d4ca7bac0325398f62868"
format_stamp: "Formatted at 2026-08-12 06:27:36 on dist-test-slave-gjrz"
server_key: "956e0efc2cb8b90b8fdf7d75e5f4be90"
server_key_iv: "37d1f72f988392cd7bae04ec2b85d80b"
server_key_version: "encryptionkey@0"
I20260812 06:27:36.934957 4118 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:27:36.936303 4143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:36.936617 4118 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:27:36.936780 4118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "cc2c6d99b23d4ca7bac0325398f62868"
format_stamp: "Formatted at 2026-08-12 06:27:36 on dist-test-slave-gjrz"
server_key: "956e0efc2cb8b90b8fdf7d75e5f4be90"
server_key_iv: "37d1f72f988392cd7bae04ec2b85d80b"
server_key_version: "encryptionkey@0"
I20260812 06:27:36.936940 4118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:36.959676 4118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:36.960140 4118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:36.960356 4118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:36.967048 4118 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:44183
I20260812 06:27:36.967142 4247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:44183 every 8 connection(s)
I20260812 06:27:36.967659 4118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:36.969231 4248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:36.970966 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 4118
I20260812 06:27:36.971122 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:36.971418 30781 external_mini_cluster.cc:1428] Setting key bf4424d606929321a5f5575fcfde94ba
I20260812 06:27:36.974141 4248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868: Bootstrap starting.
I20260812 06:27:36.975167 4248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:36.975625 4248 log.cc:824] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:36.976660 4248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868: No bootstrap required, opened a new log
I20260812 06:27:36.979594 4248 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc2c6d99b23d4ca7bac0325398f62868" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44183 } }
I20260812 06:27:36.979931 4248 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:36.979997 4257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:36.972215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34350 (local address 127.30.15.126:44183)
0812 06:27:36.972573 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:36.972594 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:36.972662 (+ 68us) server_negotiation.cc:407] Connection header received
0812 06:27:36.973612 (+ 950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:36.973634 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:36.973812 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:36.974106 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:36.974413 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.975947 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.977159 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:36.977879 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:36.978083 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:36.978992 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:36.978997 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:36.978998 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:36.979218 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:36.979335 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:36.979348 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:36.979438 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:36.979545 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 06:27:36.979724 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":129,"threads_started":1}
I20260812 06:27:36.980026 4248 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc2c6d99b23d4ca7bac0325398f62868, State: Initialized, Role: FOLLOWER
I20260812 06:27:36.980286 4248 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc2c6d99b23d4ca7bac0325398f62868" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44183 } }
I20260812 06:27:36.980402 4248 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:36.980507 4248 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:36.980588 4248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:36.981595 4248 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc2c6d99b23d4ca7bac0325398f62868" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44183 } }
I20260812 06:27:36.981717 4248 leader_election.cc:302] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc2c6d99b23d4ca7bac0325398f62868; no voters:
I20260812 06:27:36.981937 4248 leader_election.cc:288] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:36.982008 4260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:36.982213 4260 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [term 1 LEADER]: Becoming Leader. State: Replica: cc2c6d99b23d4ca7bac0325398f62868, State: Running, Role: LEADER
I20260812 06:27:36.982384 4248 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:36.982398 4260 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc2c6d99b23d4ca7bac0325398f62868" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44183 } }
I20260812 06:27:36.982971 4262 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc2c6d99b23d4ca7bac0325398f62868. Latest consensus state: current_term: 1 leader_uuid: "cc2c6d99b23d4ca7bac0325398f62868" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc2c6d99b23d4ca7bac0325398f62868" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44183 } } }
I20260812 06:27:36.982926 4261 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc2c6d99b23d4ca7bac0325398f62868" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc2c6d99b23d4ca7bac0325398f62868" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 44183 } } }
I20260812 06:27:36.983165 4262 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:36.983209 4261 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:36.983927 4276 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:36.984666 4276 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:36.986989 4276 catalog_manager.cc:1347] Generated new cluster ID: bde06d2937bf4c35a9ef9987ac6248bf
I20260812 06:27:36.987075 4276 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:36.998440 4276 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:36.999629 4276 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:37.011489 4276 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868: Generated new TSK 0
I20260812 06:27:37.011806 4276 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:37.013856 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.65:0
--local_ip_for_outbound_sockets=127.30.15.65
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44183
--builtin_ntp_servers=127.30.15.84:45233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 06:27:37.152642 4296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:37.152958 4296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:37.153025 4296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:37.154728 4296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:37.154788 4296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:37.154863 4296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.65
I20260812 06:27:37.156999 4296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:45233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.15.65
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.65
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:37.157397 4296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:37.157910 4296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:37.165799 4309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:37.166033 4296 server_base.cc:1034] running on GCE node
W20260812 06:27:37.165794 4307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:37.165798 4302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:37.166587 4296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:37.166961 4296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:37.168176 4296 hybrid_clock.cc:648] HybridClock initialized: now 1786516057168130 us; error 64 us; skew 500 ppm
I20260812 06:27:37.170090 4296 webserver.cc:460] Webserver started at http://127.30.15.65:33305/ using document root <none> and password file <none>
I20260812 06:27:37.170439 4296 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:37.170503 4296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:37.170683 4296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:37.172405 4296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/data/instance:
uuid: "3d554b00ec8249f9be9f995362745486"
format_stamp: "Formatted at 2026-08-12 06:27:37 on dist-test-slave-gjrz"
server_key: "bc80a4806642870cb04595f85d3b11ff"
server_key_iv: "71f6c9a482dc5b0d6524562aed718249"
server_key_version: "encryptionkey@0"
I20260812 06:27:37.172947 4296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance:
uuid: "3d554b00ec8249f9be9f995362745486"
format_stamp: "Formatted at 2026-08-12 06:27:37 on dist-test-slave-gjrz"
server_key: "bc80a4806642870cb04595f85d3b11ff"
server_key_iv: "71f6c9a482dc5b0d6524562aed718249"
server_key_version: "encryptionkey@0"
I20260812 06:27:37.174918 4296 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:27:37.176141 4327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:37.176414 4296 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:27:37.176558 4296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/wal
uuid: "3d554b00ec8249f9be9f995362745486"
format_stamp: "Formatted at 2026-08-12 06:27:37 on dist-test-slave-gjrz"
server_key: "bc80a4806642870cb04595f85d3b11ff"
server_key_iv: "71f6c9a482dc5b0d6524562aed718249"
server_key_version: "encryptionkey@0"
I20260812 06:27:37.176661 4296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:37.213770 4296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:37.214250 4296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:37.214520 4296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:37.214887 4296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:37.215471 4296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:37.215531 4296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:37.215587 4296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:37.215615 4296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:37.225966 4296 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.65:38667
I20260812 06:27:37.226102 4532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.65:38667 every 8 connection(s)
I20260812 06:27:37.226681 4296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/data/info.pb
I20260812 06:27:37.233119 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 4296
I20260812 06:27:37.233258 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-0/wal/instance
I20260812 06:27:37.233556 30781 external_mini_cluster.cc:1428] Setting key 96aa8eaa4c68ad269a6fbfd277113bd5
I20260812 06:27:37.235132 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.66:0
--local_ip_for_outbound_sockets=127.30.15.66
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44183
--builtin_ntp_servers=127.30.15.84:45233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:27:37.235769 4257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.227894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:35219 (local address 127.30.15.126:44183)
0812 06:27:37.227980 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:37.227983 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:37.228391 (+ 408us) server_negotiation.cc:407] Connection header received
0812 06:27:37.229320 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:37.229330 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:37.229373 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:37.229521 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:37.230595 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.231237 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.233071 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.233449 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.233560 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.235159 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:37.235161 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:37.235162 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:37.235168 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:37.235193 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:37.235200 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:37.235341 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:37.235586 (+ 245us) server_negotiation.cc:299] Negotiation successful
0812 06:27:37.235654 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:27:37.236068 4535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.227897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44183 (local address 127.30.15.65:35219)
0812 06:27:37.228193 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:37.228267 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:37.229159 (+ 892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:37.229637 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:37.229649 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:37.229658 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:37.230497 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.230501 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.231421 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.231422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.232895 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.232899 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.233624 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.233626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.233967 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.234888 (+ 921us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:27:37.234889 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:37.234956 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:27:37.235008 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:37.235380 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:37.235397 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:37.235409 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 06:27:37.235566 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 06:27:37.235731 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":120,"threads_started":1}
I20260812 06:27:37.236892 4533 heartbeater.cc:347] Connected to a master server at 127.30.15.126:44183
I20260812 06:27:37.237042 4533 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:37.237345 4533 heartbeater.cc:511] Master 127.30.15.126:44183 requested a full tablet report, sending...
I20260812 06:27:37.238215 4172 ts_manager.cc:194] Registered new tserver with Master: 3d554b00ec8249f9be9f995362745486 (127.30.15.65:38667)
I20260812 06:27:37.239102 4172 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.15.65:35219
W20260812 06:27:37.375516 4536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:37.375836 4536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:37.375860 4536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:37.377880 4536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:37.377950 4536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:37.378016 4536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.66
I20260812 06:27:37.380555 4536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:45233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.15.66
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.66
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:37.380925 4536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:37.381404 4536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:37.389459 4555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:37.389456 4548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:37.389474 4547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:37.389824 4536 server_base.cc:1034] running on GCE node
I20260812 06:27:37.390268 4536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:37.390630 4536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:37.391841 4536 hybrid_clock.cc:648] HybridClock initialized: now 1786516057391767 us; error 57 us; skew 500 ppm
I20260812 06:27:37.393831 4536 webserver.cc:460] Webserver started at http://127.30.15.66:45049/ using document root <none> and password file <none>
I20260812 06:27:37.394223 4536 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:37.394326 4536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:37.394572 4536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:37.396308 4536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/data/instance:
uuid: "1022d1a14558403099dbba0117f2ec37"
format_stamp: "Formatted at 2026-08-12 06:27:37 on dist-test-slave-gjrz"
server_key: "21b75af919d941bdc3e1ce5752996670"
server_key_iv: "a6e0626d83325ffb6501ca4a4fef7078"
server_key_version: "encryptionkey@0"
I20260812 06:27:37.396842 4536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance:
uuid: "1022d1a14558403099dbba0117f2ec37"
format_stamp: "Formatted at 2026-08-12 06:27:37 on dist-test-slave-gjrz"
server_key: "21b75af919d941bdc3e1ce5752996670"
server_key_iv: "a6e0626d83325ffb6501ca4a4fef7078"
server_key_version: "encryptionkey@0"
I20260812 06:27:37.399152 4536 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 06:27:37.400363 4563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:37.400624 4536 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:27:37.400774 4536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/wal
uuid: "1022d1a14558403099dbba0117f2ec37"
format_stamp: "Formatted at 2026-08-12 06:27:37 on dist-test-slave-gjrz"
server_key: "21b75af919d941bdc3e1ce5752996670"
server_key_iv: "a6e0626d83325ffb6501ca4a4fef7078"
server_key_version: "encryptionkey@0"
I20260812 06:27:37.400857 4536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:37.419126 4536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:37.419534 4536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:37.419723 4536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:37.420018 4536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:37.420465 4536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:37.420508 4536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:37.420549 4536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:37.420581 4536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:37.429718 4536 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.66:32773
I20260812 06:27:37.429879 4793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.66:32773 every 8 connection(s)
I20260812 06:27:37.430317 4536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/data/info.pb
I20260812 06:27:37.434022 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 4536
I20260812 06:27:37.434176 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/wal/instance
I20260812 06:27:37.434475 30781 external_mini_cluster.cc:1428] Setting key 0b9d70d333f36b97e9cbe47d78b34c5a
I20260812 06:27:37.435875 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.15.67:0
--local_ip_for_outbound_sockets=127.30.15.67
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44183
--builtin_ntp_servers=127.30.15.84:45233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 06:27:37.438838 4257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.431318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.66:48355 (local address 127.30.15.126:44183)
0812 06:27:37.431380 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:37.431382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:37.431741 (+ 359us) server_negotiation.cc:407] Connection header received
0812 06:27:37.432408 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:37.432410 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:37.432431 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:37.432512 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:37.433521 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.434499 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.436361 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.436725 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.436835 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.438262 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:37.438264 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:37.438265 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:37.438271 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:37.438307 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:37.438323 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:37.438404 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:37.438595 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 06:27:37.438650 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:27:37.439394 4801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.431257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44183 (local address 127.30.15.66:48355)
0812 06:27:37.431574 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:37.431629 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:37.432286 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:37.432615 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:37.432619 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:37.432633 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:37.433397 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.433403 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.434680 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.434681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.436260 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.436263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.436839 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.436840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.437096 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.437978 (+ 882us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:27:37.437978 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:37.438047 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:27:37.438103 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:37.438426 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:37.438432 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:37.438447 (+ 15us) client_negotiation.cc:769] Sending connection context
0812 06:27:37.438597 (+ 150us) client_negotiation.cc:240] Negotiation successful
0812 06:27:37.438852 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":136,"threads_started":1}
I20260812 06:27:37.440052 4798 heartbeater.cc:347] Connected to a master server at 127.30.15.126:44183
I20260812 06:27:37.440182 4798 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:37.440485 4798 heartbeater.cc:511] Master 127.30.15.126:44183 requested a full tablet report, sending...
I20260812 06:27:37.441110 4172 ts_manager.cc:194] Registered new tserver with Master: 1022d1a14558403099dbba0117f2ec37 (127.30.15.66:32773)
I20260812 06:27:37.441931 4172 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.15.66:48355
W20260812 06:27:37.592902 4803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:37.593227 4803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:37.593274 4803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:37.595068 4803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:37.595129 4803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:37.595189 4803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.15.67
I20260812 06:27:37.597299 4803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:45233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.15.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.15.67
--webserver_port=0
--tserver_master_addrs=127.30.15.126:44183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.15.67
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:37.597699 4803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:37.598241 4803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:37.606130 4817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:37.606138 4823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:37.606143 4819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:37.607323 4803 server_base.cc:1034] running on GCE node
I20260812 06:27:37.607764 4803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:37.608137 4803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:37.609369 4803 hybrid_clock.cc:648] HybridClock initialized: now 1786516057609307 us; error 87 us; skew 500 ppm
I20260812 06:27:37.612212 4803 webserver.cc:460] Webserver started at http://127.30.15.67:34979/ using document root <none> and password file <none>
I20260812 06:27:37.612807 4803 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:37.612947 4803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:37.613260 4803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:37.615036 4803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/data/instance:
uuid: "a5adc8eb44e349e38bafdf000867fe42"
format_stamp: "Formatted at 2026-08-12 06:27:37 on dist-test-slave-gjrz"
server_key: "b83a24ee55b6c003d054be7cc610759f"
server_key_iv: "1cc5f85253272d62e52936a7f74c7bb7"
server_key_version: "encryptionkey@0"
I20260812 06:27:37.615595 4803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance:
uuid: "a5adc8eb44e349e38bafdf000867fe42"
format_stamp: "Formatted at 2026-08-12 06:27:37 on dist-test-slave-gjrz"
server_key: "b83a24ee55b6c003d054be7cc610759f"
server_key_iv: "1cc5f85253272d62e52936a7f74c7bb7"
server_key_version: "encryptionkey@0"
I20260812 06:27:37.617688 4803 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260812 06:27:37.618880 4838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:37.619117 4803 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:27:37.619323 4803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/wal
uuid: "a5adc8eb44e349e38bafdf000867fe42"
format_stamp: "Formatted at 2026-08-12 06:27:37 on dist-test-slave-gjrz"
server_key: "b83a24ee55b6c003d054be7cc610759f"
server_key_iv: "1cc5f85253272d62e52936a7f74c7bb7"
server_key_version: "encryptionkey@0"
I20260812 06:27:37.619431 4803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:37.633373 4803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:37.633795 4803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:37.633985 4803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:37.634274 4803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 06:27:37.634773 4803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:27:37.634822 4803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:37.634868 4803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 06:27:37.634927 4803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:37.645107 4803 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.67:46717
I20260812 06:27:37.645162 5058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.67:46717 every 8 connection(s)
I20260812 06:27:37.645612 4803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/data/info.pb
I20260812 06:27:37.646757 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 4803
I20260812 06:27:37.646901 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/wal/instance
I20260812 06:27:37.647146 30781 external_mini_cluster.cc:1428] Setting key 92100ec47f9cea29fa7e9456ec3a5fb5
I20260812 06:27:37.653764 4257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.646620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.67:51553 (local address 127.30.15.126:44183)
0812 06:27:37.646681 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:37.646683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:37.647142 (+ 459us) server_negotiation.cc:407] Connection header received
0812 06:27:37.648109 (+ 967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:37.648112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:37.648126 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:37.648292 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:37.649438 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.650164 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.651749 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.652074 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.652162 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.653282 (+ 1120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:37.653284 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:37.653285 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:37.653291 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:37.653312 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:37.653316 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:37.653378 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:37.653601 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 06:27:37.653653 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:27:37.654093 5061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.646633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:44183 (local address 127.30.15.67:51553)
0812 06:27:37.646945 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:37.647006 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:37.647964 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:37.648426 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:37.648433 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:37.648450 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:27:37.649318 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.649324 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.650288 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.650289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.651621 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.651624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.652182 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.652184 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.652383 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.653094 (+ 711us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 06:27:37.653095 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:27:37.653130 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 06:27:37.653164 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:27:37.653384 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:27:37.653395 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:27:37.653398 (+ 3us) client_negotiation.cc:769] Sending connection context
0812 06:27:37.653601 (+ 203us) client_negotiation.cc:240] Negotiation successful
0812 06:27:37.653792 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":117,"threads_started":1}
I20260812 06:27:37.654711 5059 heartbeater.cc:347] Connected to a master server at 127.30.15.126:44183
I20260812 06:27:37.654820 5059 heartbeater.cc:464] Registering TS with master...
I20260812 06:27:37.655050 5059 heartbeater.cc:511] Master 127.30.15.126:44183 requested a full tablet report, sending...
I20260812 06:27:37.655658 4172 ts_manager.cc:194] Registered new tserver with Master: a5adc8eb44e349e38bafdf000867fe42 (127.30.15.67:46717)
I20260812 06:27:37.656101 4172 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.15.67:51553
I20260812 06:27:37.659550 30781 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 06:27:37.665130 4257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.661330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34358 (local address 127.30.15.126:44183)
0812 06:27:37.661398 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:37.661399 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:37.661597 (+ 198us) server_negotiation.cc:407] Connection header received
0812 06:27:37.661710 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:37.661711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:37.661724 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:37.661794 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:37.661999 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.662659 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.663681 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.664002 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.664096 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.664845 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:37.664846 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:37.664846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:37.664850 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:37.664875 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:37.664880 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:37.664942 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:37.665010 (+ 68us) server_negotiation.cc:299] Negotiation successful
0812 06:27:37.665055 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 06:27:37.667395 4172 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34358:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 06:27:37.669745 4172 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:27:37.679090 5080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.672848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:38667 (local address 127.0.0.1:56198)
0812 06:27:37.673115 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:37.673199 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:37.673387 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:37.673888 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:37.673893 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:37.673896 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:37.673994 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.673996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.676020 (+ 2024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.676021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.677200 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.677203 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.678633 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.678634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.678735 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.678766 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 06:27:37.678901 (+ 135us) client_negotiation.cc:240] Negotiation successful
0812 06:27:37.678980 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":65,"threads_started":1}
I20260812 06:27:37.679229 5089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.673182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:32773 (local address 127.0.0.1:52328)
0812 06:27:37.673498 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:37.673510 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:37.673583 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:37.674377 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:37.674378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:37.674381 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:37.674452 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.674455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.675745 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.675746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.677386 (+ 1640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.677389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.678908 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.678910 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.678995 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.679004 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 06:27:37.679084 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 06:27:37.679142 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":233,"threads_started":1}
I20260812 06:27:37.679298 5093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.673779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52328 (local address 127.30.15.66:32773)
0812 06:27:37.674121 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:37.674144 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:37.674188 (+ 44us) server_negotiation.cc:407] Connection header received
0812 06:27:37.674242 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:37.674243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:37.674263 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:37.674369 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:37.674539 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.675591 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.677544 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.678748 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.678840 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.678980 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:37.679114 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 06:27:37.679165 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":128,"threads_started":1}
I20260812 06:27:37.679456 5088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.672997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56198 (local address 127.30.15.65:38667)
0812 06:27:37.673621 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:37.673625 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:37.673633 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:27:37.673695 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:37.673698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:37.673724 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:37.674233 (+ 509us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:37.674325 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.675877 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.677285 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.678451 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.678620 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.678766 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:37.679228 (+ 462us) server_negotiation.cc:299] Negotiation successful
0812 06:27:37.679336 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":131,"threads_started":1}
I20260812 06:27:37.680133 5079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.672866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:46717 (local address 127.0.0.1:36374)
0812 06:27:37.673412 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:37.673427 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:37.673491 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:37.673888 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:37.673893 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:37.673899 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:37.674020 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.674022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.676502 (+ 2480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.676503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.677792 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.677794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.679804 (+ 2010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.679815 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.679903 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.679907 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:37.679961 (+ 54us) client_negotiation.cc:240] Negotiation successful
0812 06:27:37.680014 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":125,"threads_started":1}
I20260812 06:27:37.680823 5086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.672981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36374 (local address 127.30.15.67:46717)
0812 06:27:37.673364 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:37.673369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:37.673601 (+ 232us) server_negotiation.cc:407] Connection header received
0812 06:27:37.673652 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:37.673655 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:37.673680 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:37.673797 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:37.674253 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.676315 (+ 2062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.677891 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.678992 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.679109 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.680462 (+ 1353us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:37.680635 (+ 173us) server_negotiation.cc:299] Negotiation successful
0812 06:27:37.680705 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":112,"threads_started":1}
I20260812 06:27:37.680830 4414 tablet_service.cc:1467] Processing CreateTablet for tablet 1703039527624967b6f25ba9208c2a91 (DEFAULT_TABLE table=test-table [id=a415d7304e92445a9b52b6704b28c749]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:37.680904 4668 tablet_service.cc:1467] Processing CreateTablet for tablet 1703039527624967b6f25ba9208c2a91 (DEFAULT_TABLE table=test-table [id=a415d7304e92445a9b52b6704b28c749]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:37.681507 4414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1703039527624967b6f25ba9208c2a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:37.681684 4668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1703039527624967b6f25ba9208c2a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:37.682006 4938 tablet_service.cc:1467] Processing CreateTablet for tablet 1703039527624967b6f25ba9208c2a91 (DEFAULT_TABLE table=test-table [id=a415d7304e92445a9b52b6704b28c749]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:27:37.682633 4938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1703039527624967b6f25ba9208c2a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:37.686084 5094 tablet_bootstrap.cc:492] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486: Bootstrap starting.
I20260812 06:27:37.687426 5094 tablet_bootstrap.cc:654] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:37.687989 5098 tablet_bootstrap.cc:492] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37: Bootstrap starting.
I20260812 06:27:37.688228 5094 log.cc:824] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:37.688831 5100 tablet_bootstrap.cc:492] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42: Bootstrap starting.
I20260812 06:27:37.689278 5098 tablet_bootstrap.cc:654] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:37.689742 5098 log.cc:824] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:37.689821 5094 tablet_bootstrap.cc:492] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486: No bootstrap required, opened a new log
I20260812 06:27:37.689916 5094 ts_tablet_manager.cc:1397] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260812 06:27:37.689965 5100 tablet_bootstrap.cc:654] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:37.690606 5100 log.cc:824] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:37.690949 5098 tablet_bootstrap.cc:492] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37: No bootstrap required, opened a new log
I20260812 06:27:37.691133 5098 ts_tablet_manager.cc:1397] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:27:37.692077 5100 tablet_bootstrap.cc:492] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42: No bootstrap required, opened a new log
I20260812 06:27:37.692195 5100 ts_tablet_manager.cc:1397] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260812 06:27:37.694293 5098 raft_consensus.cc:348] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d554b00ec8249f9be9f995362745486" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38667 } } peers { permanent_uuid: "a5adc8eb44e349e38bafdf000867fe42" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46717 } } peers { permanent_uuid: "1022d1a14558403099dbba0117f2ec37" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 32773 } }
I20260812 06:27:37.694487 5098 raft_consensus.cc:374] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:37.694550 5098 raft_consensus.cc:729] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1022d1a14558403099dbba0117f2ec37, State: Initialized, Role: FOLLOWER
I20260812 06:27:37.694716 5094 raft_consensus.cc:348] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d554b00ec8249f9be9f995362745486" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38667 } } peers { permanent_uuid: "a5adc8eb44e349e38bafdf000867fe42" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46717 } } peers { permanent_uuid: "1022d1a14558403099dbba0117f2ec37" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 32773 } }
I20260812 06:27:37.694921 5098 consensus_queue.cc:260] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d554b00ec8249f9be9f995362745486" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38667 } } peers { permanent_uuid: "a5adc8eb44e349e38bafdf000867fe42" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46717 } } peers { permanent_uuid: "1022d1a14558403099dbba0117f2ec37" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 32773 } }
I20260812 06:27:37.695149 5094 raft_consensus.cc:374] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:37.695322 5094 raft_consensus.cc:729] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d554b00ec8249f9be9f995362745486, State: Initialized, Role: FOLLOWER
I20260812 06:27:37.695456 5098 ts_tablet_manager.cc:1428] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37: Time spent starting tablet: real 0.004s user 0.000s sys 0.005s
I20260812 06:27:37.695688 4798 heartbeater.cc:503] Master 127.30.15.126:44183 was elected leader, sending a full tablet report...
I20260812 06:27:37.695603 5094 consensus_queue.cc:260] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d554b00ec8249f9be9f995362745486" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38667 } } peers { permanent_uuid: "a5adc8eb44e349e38bafdf000867fe42" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46717 } } peers { permanent_uuid: "1022d1a14558403099dbba0117f2ec37" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 32773 } }
I20260812 06:27:37.696028 5094 ts_tablet_manager.cc:1428] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260812 06:27:37.696255 4533 heartbeater.cc:503] Master 127.30.15.126:44183 was elected leader, sending a full tablet report...
I20260812 06:27:37.696877 5100 raft_consensus.cc:348] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d554b00ec8249f9be9f995362745486" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38667 } } peers { permanent_uuid: "a5adc8eb44e349e38bafdf000867fe42" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46717 } } peers { permanent_uuid: "1022d1a14558403099dbba0117f2ec37" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 32773 } }
I20260812 06:27:37.697221 5100 raft_consensus.cc:374] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:37.697296 5100 raft_consensus.cc:729] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5adc8eb44e349e38bafdf000867fe42, State: Initialized, Role: FOLLOWER
I20260812 06:27:37.697486 5100 consensus_queue.cc:260] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d554b00ec8249f9be9f995362745486" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38667 } } peers { permanent_uuid: "a5adc8eb44e349e38bafdf000867fe42" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46717 } } peers { permanent_uuid: "1022d1a14558403099dbba0117f2ec37" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 32773 } }
I20260812 06:27:37.697934 5100 ts_tablet_manager.cc:1428] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 06:27:37.697999 5059 heartbeater.cc:503] Master 127.30.15.126:44183 was elected leader, sending a full tablet report...
W20260812 06:27:37.727721 4534 tablet.cc:2369] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:27:37.826143 5108 raft_consensus.cc:482] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:27:37.826314 5108 raft_consensus.cc:504] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d554b00ec8249f9be9f995362745486" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38667 } } peers { permanent_uuid: "a5adc8eb44e349e38bafdf000867fe42" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46717 } } peers { permanent_uuid: "1022d1a14558403099dbba0117f2ec37" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 32773 } }
I20260812 06:27:37.826807 5108 leader_election.cc:288] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5adc8eb44e349e38bafdf000867fe42 (127.30.15.67:46717), 1022d1a14558403099dbba0117f2ec37 (127.30.15.66:32773)
I20260812 06:27:37.830579 5093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.827087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:51657 (local address 127.30.15.66:32773)
0812 06:27:37.827172 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:37.827174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:37.827414 (+ 240us) server_negotiation.cc:407] Connection header received
0812 06:27:37.827521 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:37.827522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:37.827552 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:37.827645 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:37.827831 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.828437 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.829704 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.830161 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.830249 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.830259 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:37.830434 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 06:27:37.830489 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 06:27:37.830591 5086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.827189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.15.65:60855 (local address 127.30.15.67:46717)
0812 06:27:37.827290 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:37.827292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:37.827308 (+ 16us) server_negotiation.cc:407] Connection header received
0812 06:27:37.827441 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:37.827442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:37.827457 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:37.827526 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 06:27:37.827832 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.828441 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.829718 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.830175 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.830256 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.830264 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:37.830457 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 06:27:37.830502 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:27:37.830652 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.827018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.66:32773 (local address 127.30.15.65:51657)
0812 06:27:37.827309 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:37.827324 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:37.827415 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:37.827633 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:37.827634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:37.827637 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:37.827749 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.827751 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.828540 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.828541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.829597 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.829600 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.830256 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.830257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.830347 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.830351 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:37.830417 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 06:27:37.830470 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":142,"threads_started":1}
I20260812 06:27:37.830662 5110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.826989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.67:46717 (local address 127.30.15.65:60855)
0812 06:27:37.827186 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:37.827204 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 06:27:37.827333 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:27:37.827555 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:27:37.827556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:27:37.827559 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 06:27:37.827665 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.827668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.828557 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.828558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.829604 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:27:37.829607 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.830288 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.830289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:27:37.830366 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.830370 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 06:27:37.830440 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 06:27:37.830496 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":50,"thread_start_us":109,"threads_started":1}
I20260812 06:27:37.831125 4969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1703039527624967b6f25ba9208c2a91" candidate_uuid: "3d554b00ec8249f9be9f995362745486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5adc8eb44e349e38bafdf000867fe42" is_pre_election: true
I20260812 06:27:37.831357 4969 raft_consensus.cc:2454] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d554b00ec8249f9be9f995362745486 in term 0.
I20260812 06:27:37.831444 4708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1703039527624967b6f25ba9208c2a91" candidate_uuid: "3d554b00ec8249f9be9f995362745486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1022d1a14558403099dbba0117f2ec37" is_pre_election: true
I20260812 06:27:37.831647 4708 raft_consensus.cc:2454] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d554b00ec8249f9be9f995362745486 in term 0.
I20260812 06:27:37.831670 4328 leader_election.cc:302] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d554b00ec8249f9be9f995362745486, a5adc8eb44e349e38bafdf000867fe42; no voters:
I20260812 06:27:37.831820 5108 raft_consensus.cc:2781] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:27:37.831894 5108 raft_consensus.cc:482] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:27:37.831929 5108 raft_consensus.cc:3037] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:37.832883 5108 raft_consensus.cc:504] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d554b00ec8249f9be9f995362745486" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38667 } } peers { permanent_uuid: "a5adc8eb44e349e38bafdf000867fe42" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46717 } } peers { permanent_uuid: "1022d1a14558403099dbba0117f2ec37" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 32773 } }
I20260812 06:27:37.833050 5108 leader_election.cc:288] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [CANDIDATE]: Term 1 election: Requested vote from peers a5adc8eb44e349e38bafdf000867fe42 (127.30.15.67:46717), 1022d1a14558403099dbba0117f2ec37 (127.30.15.66:32773)
I20260812 06:27:37.833235 4708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1703039527624967b6f25ba9208c2a91" candidate_uuid: "3d554b00ec8249f9be9f995362745486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1022d1a14558403099dbba0117f2ec37"
I20260812 06:27:37.833252 4969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1703039527624967b6f25ba9208c2a91" candidate_uuid: "3d554b00ec8249f9be9f995362745486" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5adc8eb44e349e38bafdf000867fe42"
I20260812 06:27:37.833325 4708 raft_consensus.cc:3037] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:37.833328 4969 raft_consensus.cc:3037] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:37.834229 4969 raft_consensus.cc:2454] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d554b00ec8249f9be9f995362745486 in term 1.
I20260812 06:27:37.834233 4708 raft_consensus.cc:2454] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d554b00ec8249f9be9f995362745486 in term 1.
I20260812 06:27:37.834455 4328 leader_election.cc:302] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d554b00ec8249f9be9f995362745486, a5adc8eb44e349e38bafdf000867fe42; no voters:
I20260812 06:27:37.834594 5108 raft_consensus.cc:2781] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:37.834743 5108 raft_consensus.cc:686] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 1 LEADER]: Becoming Leader. State: Replica: 3d554b00ec8249f9be9f995362745486, State: Running, Role: LEADER
I20260812 06:27:37.834879 5108 consensus_queue.cc:237] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d554b00ec8249f9be9f995362745486" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38667 } } peers { permanent_uuid: "a5adc8eb44e349e38bafdf000867fe42" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46717 } } peers { permanent_uuid: "1022d1a14558403099dbba0117f2ec37" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 32773 } }
I20260812 06:27:37.835871 4172 catalog_manager.cc:5495] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d554b00ec8249f9be9f995362745486 (127.30.15.65). New cstate: current_term: 1 leader_uuid: "3d554b00ec8249f9be9f995362745486" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d554b00ec8249f9be9f995362745486" member_type: VOTER last_known_addr { host: "127.30.15.65" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5adc8eb44e349e38bafdf000867fe42" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1022d1a14558403099dbba0117f2ec37" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 32773 } health_report { overall_health: UNKNOWN } } }
I20260812 06:27:37.865401 5088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.862395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56200 (local address 127.30.15.65:38667)
0812 06:27:37.862462 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:37.862464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:37.862478 (+ 14us) server_negotiation.cc:407] Connection header received
0812 06:27:37.862556 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:37.862557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:37.862586 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:37.862676 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:27:37.862845 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.863489 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.864440 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:37.864670 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:37.864747 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:37.864936 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:27:37.865078 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:27:37.865181 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:37.865238 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 06:27:37.865265 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 06:27:37.867542 4708 raft_consensus.cc:1261] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37 [term 1 FOLLOWER]: Refusing update from remote peer 3d554b00ec8249f9be9f995362745486: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:27:37.867578 4969 raft_consensus.cc:1261] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42 [term 1 FOLLOWER]: Refusing update from remote peer 3d554b00ec8249f9be9f995362745486: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:27:37.868010 5115 consensus_queue.cc:1035] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1022d1a14558403099dbba0117f2ec37" member_type: VOTER last_known_addr { host: "127.30.15.66" port: 32773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:27:37.868171 5108 consensus_queue.cc:1035] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5adc8eb44e349e38bafdf000867fe42" member_type: VOTER last_known_addr { host: "127.30.15.67" port: 46717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:27:37.872174 5123 mvcc.cc:205] Tried to move back new op lower bound from 7317569773022564352 to 7317569772892532736. Current Snapshot: MvccSnapshot[applied={T|T < 7317569773022564352}]
I20260812 06:27:37.875068 4171 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34358:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:27:37.875175 4171 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34358:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 06:27:37.876116 4171 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cc2c6d99b23d4ca7bac0325398f62868: Sending DeleteTablet for 3 replicas of tablet 1703039527624967b6f25ba9208c2a91
I20260812 06:27:37.876580 4414 tablet_service.cc:1514] Processing DeleteTablet for tablet 1703039527624967b6f25ba9208c2a91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:37 UTC) from {username='slave'} at 127.0.0.1:56198
I20260812 06:27:37.876619 4668 tablet_service.cc:1514] Processing DeleteTablet for tablet 1703039527624967b6f25ba9208c2a91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:37 UTC) from {username='slave'} at 127.0.0.1:52328
I20260812 06:27:37.876907 4938 tablet_service.cc:1514] Processing DeleteTablet for tablet 1703039527624967b6f25ba9208c2a91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 06:27:37 UTC) from {username='slave'} at 127.0.0.1:36374
I20260812 06:27:37.877184 5138 tablet_replica.cc:330] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42: stopping tablet replica
I20260812 06:27:37.877262 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 4296
I20260812 06:27:37.877373 5137 tablet_replica.cc:330] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486: stopping tablet replica
I20260812 06:27:37.877508 5137 raft_consensus.cc:2229] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:27:37.877504 5138 raft_consensus.cc:2229] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:27:37.877688 5137 raft_consensus.cc:2258] T 1703039527624967b6f25ba9208c2a91 P 3d554b00ec8249f9be9f995362745486 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:37.877960 5136 tablet_replica.cc:330] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37: stopping tablet replica
I20260812 06:27:37.877802 5138 raft_consensus.cc:2258] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:37.878132 5136 raft_consensus.cc:2229] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:27:37.878311 5136 raft_consensus.cc:2258] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:27:37.878849 5138 ts_tablet_manager.cc:1905] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:27:37.882025 5138 ts_tablet_manager.cc:1918] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:27:37.882138 5138 log.cc:1196] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-2/wal/wals/1703039527624967b6f25ba9208c2a91
I20260812 06:27:37.882514 5138 ts_tablet_manager.cc:1939] T 1703039527624967b6f25ba9208c2a91 P a5adc8eb44e349e38bafdf000867fe42: Deleting consensus metadata
I20260812 06:27:37.883026 4145 catalog_manager.cc:4841] TS a5adc8eb44e349e38bafdf000867fe42 (127.30.15.67:46717): tablet 1703039527624967b6f25ba9208c2a91 (table test-table [id=a415d7304e92445a9b52b6704b28c749]) successfully deleted
I20260812 06:27:37.885973 5136 ts_tablet_manager.cc:1905] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 06:27:37.887745 5136 ts_tablet_manager.cc:1918] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 06:27:37.887830 5136 log.cc:1196] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37: Deleting WAL directory at /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786515816548244-30781-0/minicluster-data/ts-1/wal/wals/1703039527624967b6f25ba9208c2a91
I20260812 06:27:37.888118 5136 ts_tablet_manager.cc:1939] T 1703039527624967b6f25ba9208c2a91 P 1022d1a14558403099dbba0117f2ec37: Deleting consensus metadata
I20260812 06:27:37.888622 4147 catalog_manager.cc:4841] TS 1022d1a14558403099dbba0117f2ec37 (127.30.15.66:32773): tablet 1703039527624967b6f25ba9208c2a91 (table test-table [id=a415d7304e92445a9b52b6704b28c749]) successfully deleted
W20260812 06:27:37.892161 4147 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.15.65:38667 (error 108)
I20260812 06:27:37.892444 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 4536
I20260812 06:27:37.897680 5079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:37.892671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.65:38667 (local address 127.0.0.1:56214)
0812 06:27:37.897527 (+ 4856us) negotiation.cc:107] Waiting for socket to connect
0812 06:27:37.897626 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.65:38667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4825}
W20260812 06:27:37.916464 4147 catalog_manager.cc:4584] TS 3d554b00ec8249f9be9f995362745486 (127.30.15.65:38667): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1703039527624967b6f25ba9208c2a91: Network error: Client connection negotiation failed: client connection to 127.30.15.65:38667: connect: Connection refused (error 111)
I20260812 06:27:37.922053 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 4803
I20260812 06:27:37.936524 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 4118
2026-08-12T06:27:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1208 ms)
[----------] 6 tests from EncryptionPolicyTest (9626 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:38 dist-test-slave-gjrz krb5kdc[5143](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:38 dist-test-slave-gjrz krb5kdc[5143](info): set up 2 sockets
Aug 12 06:27:38 dist-test-slave-gjrz krb5kdc[5143](info): commencing operation
krb5kdc: starting...
W20260812 06:27:39.155184 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:39 dist-test-slave-gjrz krb5kdc[5143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:27:39.266040 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36075
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36075
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:39.344601 5162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:39.344784 5162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:39.344805 5162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:39.345856 5162 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:39.345889 5162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:39.345901 5162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:39.345913 5162 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:39.345927 5162 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:39.347307 5162 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36075
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:39.347481 5162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:39.347640 5162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 06:27:39.352144 5162 server_base.cc:1034] running on GCE node
W20260812 06:27:39.352092 5169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:39.352147 5168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:39.352087 5173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:39.352571 5162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:39.352823 5162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:39.353952 5162 hybrid_clock.cc:648] HybridClock initialized: now 1786516059353944 us; error 27 us; skew 500 ppm
Aug 12 06:27:39 dist-test-slave-gjrz krb5kdc[5143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516059, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:39.359202 5162 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:27:39.359620 5162 webserver.cc:460] Webserver started at http://127.0.0.1:34971/ using document root <none> and password file <none>
I20260812 06:27:39.359831 5162 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:39.359874 5162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:39.359992 5162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:39.360948 5162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "a8090ebd8c4c438887ba6d52fdc87079"
format_stamp: "Formatted at 2026-08-12 06:27:39 on dist-test-slave-gjrz"
server_key: "9de64dc01484567b42df18f953507c9a"
server_key_iv: "c3359303f4be0317b8fc8ffb33c98a26"
server_key_version: "encryptionkey@0"
I20260812 06:27:39.361279 5162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "a8090ebd8c4c438887ba6d52fdc87079"
format_stamp: "Formatted at 2026-08-12 06:27:39 on dist-test-slave-gjrz"
server_key: "9de64dc01484567b42df18f953507c9a"
server_key_iv: "c3359303f4be0317b8fc8ffb33c98a26"
server_key_version: "encryptionkey@0"
I20260812 06:27:39.362483 5162 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:27:39.363126 5186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:39.363296 5162 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:39.363380 5162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "a8090ebd8c4c438887ba6d52fdc87079"
format_stamp: "Formatted at 2026-08-12 06:27:39 on dist-test-slave-gjrz"
server_key: "9de64dc01484567b42df18f953507c9a"
server_key_iv: "c3359303f4be0317b8fc8ffb33c98a26"
server_key_version: "encryptionkey@0"
I20260812 06:27:39.363451 5162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:39.372717 5162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:39.374286 5162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:39.374390 5162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:39.378204 5162 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36075
I20260812 06:27:39.378234 5294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36075 every 8 connection(s)
I20260812 06:27:39.378525 5162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:39.379346 5295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:39.380003 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 5162
I20260812 06:27:39.380116 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:39.380292 30781 external_mini_cluster.cc:1428] Setting key b7cc67ea3eae7c5168f532d3797a56b0
I20260812 06:27:39.382241 5295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079: Bootstrap starting.
I20260812 06:27:39.382922 5295 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:39.383235 5295 log.cc:824] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:39.383921 5295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079: No bootstrap required, opened a new log
I20260812 06:27:39.386029 5295 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8090ebd8c4c438887ba6d52fdc87079" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36075 } }
I20260812 06:27:39.386163 5295 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:39.386184 5295 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8090ebd8c4c438887ba6d52fdc87079, State: Initialized, Role: FOLLOWER
I20260812 06:27:39.386286 5295 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8090ebd8c4c438887ba6d52fdc87079" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36075 } }
I20260812 06:27:39.386355 5295 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:39.386379 5295 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:39.386422 5295 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [term 0 FOLLOWER]: Advancing to term 1
Aug 12 06:27:39 dist-test-slave-gjrz krb5kdc[5143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516059, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 06:27:39.386957 5295 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8090ebd8c4c438887ba6d52fdc87079" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36075 } }
I20260812 06:27:39.387051 5295 leader_election.cc:302] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8090ebd8c4c438887ba6d52fdc87079; no voters:
I20260812 06:27:39.387195 5295 leader_election.cc:288] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:39.387239 5302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:39.387449 5302 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [term 1 LEADER]: Becoming Leader. State: Replica: a8090ebd8c4c438887ba6d52fdc87079, State: Running, Role: LEADER
I20260812 06:27:39.387473 5295 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:39.387826 5302 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8090ebd8c4c438887ba6d52fdc87079" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36075 } }
I20260812 06:27:39.388190 5305 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8090ebd8c4c438887ba6d52fdc87079. Latest consensus state: current_term: 1 leader_uuid: "a8090ebd8c4c438887ba6d52fdc87079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8090ebd8c4c438887ba6d52fdc87079" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36075 } } }
I20260812 06:27:39.388267 5305 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:39.388705 5303 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8090ebd8c4c438887ba6d52fdc87079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8090ebd8c4c438887ba6d52fdc87079" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36075 } } }
I20260812 06:27:39.388797 5303 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:39.389035 5317 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:39.389607 5317 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:39.391112 5317 catalog_manager.cc:1347] Generated new cluster ID: b004786d020d4e698f383e771f803465
I20260812 06:27:39.391319 5317 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:39.391558 5299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:39.380793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34705 (local address 127.0.0.1:36075)
0812 06:27:39.380986 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:39.380995 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:39.381040 (+ 45us) server_negotiation.cc:407] Connection header received
0812 06:27:39.381485 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:39.381494 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:39.381565 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:39.381705 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:39.382313 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:39.383622 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:39.384368 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:39.384985 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:39.385106 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:39.387217 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:39.387220 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:39.387220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:39.387230 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:39.389740 (+ 2510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:39.390144 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:39.390147 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:39.390147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:39.390230 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:39.390440 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:39.390441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:39.390441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:39.390718 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:39.390862 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:39.391319 (+ 457us) server_negotiation.cc:299] Negotiation successful
0812 06:27:39.391422 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":77,"threads_started":1}
I20260812 06:27:39.392416 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:39.399362 5299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:39.393644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36225 (local address 127.0.0.1:36075)
0812 06:27:39.393689 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:39.393691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:39.393803 (+ 112us) server_negotiation.cc:407] Connection header received
0812 06:27:39.393851 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:39.393852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:39.393862 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:39.393905 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:39.394375 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:39.395101 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:39.395814 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:39.396051 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:39.396105 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:39.397125 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:39.397126 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:39.397126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:39.397132 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:39.398305 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:39.398630 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:39.398631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:39.398631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:39.398681 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:39.398870 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:39.398870 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:39.398871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:39.398969 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:39.399049 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:39.399206 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 06:27:39.399285 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:27:39.406306 5317 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:39.406756 5317 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:39.414855 5317 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8090ebd8c4c438887ba6d52fdc87079: Generated new TSK 0
I20260812 06:27:39.415006 5317 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:39.418889 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 5162
W20260812 06:27:39.433928 5140 connection.cc:535] client connection to 127.0.0.1:36075 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36075): Connection reset by peer (error 104)
2026-08-12T06:27:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1476 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:39 dist-test-slave-gjrz krb5kdc[5350](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:39 dist-test-slave-gjrz krb5kdc[5350](info): set up 2 sockets
Aug 12 06:27:39 dist-test-slave-gjrz krb5kdc[5350](info): commencing operation
krb5kdc: starting...
W20260812 06:27:40.621903 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:40 dist-test-slave-gjrz krb5kdc[5350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516060, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:27:40.733934 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45933
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:40.812070 5376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:40.812242 5376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:40.812261 5376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:40.813349 5376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:40.813387 5376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:40.813400 5376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:40.813411 5376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:40.813434 5376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:40.814834 5376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45933
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:40.815047 5376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:40.815245 5376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:40.819757 5383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:40.819780 5387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:40.819914 5376 server_base.cc:1034] running on GCE node
W20260812 06:27:40.819810 5384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:40.820209 5376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:40.820456 5376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:40.821590 5376 hybrid_clock.cc:648] HybridClock initialized: now 1786516060821580 us; error 27 us; skew 500 ppm
Aug 12 06:27:40 dist-test-slave-gjrz krb5kdc[5350](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516060, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:40.823861 5376 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:27:40.824290 5376 webserver.cc:460] Webserver started at http://127.0.0.1:45269/ using document root <none> and password file <none>
I20260812 06:27:40.824496 5376 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:40.824540 5376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:40.824656 5376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:40.825608 5376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "6a9615e9521141d5a9c8f9721c649b7b"
format_stamp: "Formatted at 2026-08-12 06:27:40 on dist-test-slave-gjrz"
server_key: "8eede89d79cec4bf82759024cd673364"
server_key_iv: "c303fd4da95bc900dc7a9994e35b78ab"
server_key_version: "encryptionkey@0"
I20260812 06:27:40.825915 5376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "6a9615e9521141d5a9c8f9721c649b7b"
format_stamp: "Formatted at 2026-08-12 06:27:40 on dist-test-slave-gjrz"
server_key: "8eede89d79cec4bf82759024cd673364"
server_key_iv: "c303fd4da95bc900dc7a9994e35b78ab"
server_key_version: "encryptionkey@0"
I20260812 06:27:40.827082 5376 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:27:40.827804 5404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:40.827960 5376 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:40.828054 5376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "6a9615e9521141d5a9c8f9721c649b7b"
format_stamp: "Formatted at 2026-08-12 06:27:40 on dist-test-slave-gjrz"
server_key: "8eede89d79cec4bf82759024cd673364"
server_key_iv: "c303fd4da95bc900dc7a9994e35b78ab"
server_key_version: "encryptionkey@0"
I20260812 06:27:40.828114 5376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:40.852356 5376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:40.853895 5376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:40.854020 5376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:40.857826 5376 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45933
I20260812 06:27:40.857879 5506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45933 every 8 connection(s)
I20260812 06:27:40.858175 5376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:40.858929 5509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:40.861095 5509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b: Bootstrap starting.
I20260812 06:27:40.861644 5509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:40.861917 5509 log.cc:824] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:40.862531 5509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b: No bootstrap required, opened a new log
I20260812 06:27:40.864135 5509 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9615e9521141d5a9c8f9721c649b7b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45933 } }
I20260812 06:27:40.864264 5509 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:40.864284 5509 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a9615e9521141d5a9c8f9721c649b7b, State: Initialized, Role: FOLLOWER
I20260812 06:27:40.864413 5509 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9615e9521141d5a9c8f9721c649b7b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45933 } }
I20260812 06:27:40.864475 5509 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:40.864495 5509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:40.864542 5509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:40.865029 5509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9615e9521141d5a9c8f9721c649b7b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45933 } }
I20260812 06:27:40.865121 5509 leader_election.cc:302] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a9615e9521141d5a9c8f9721c649b7b; no voters:
I20260812 06:27:40.865273 5509 leader_election.cc:288] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:40.865307 5513 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:40.865504 5513 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [term 1 LEADER]: Becoming Leader. State: Replica: 6a9615e9521141d5a9c8f9721c649b7b, State: Running, Role: LEADER
I20260812 06:27:40.865558 5509 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:40.865661 5513 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9615e9521141d5a9c8f9721c649b7b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45933 } }
I20260812 06:27:40.866174 5516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a9615e9521141d5a9c8f9721c649b7b. Latest consensus state: current_term: 1 leader_uuid: "6a9615e9521141d5a9c8f9721c649b7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9615e9521141d5a9c8f9721c649b7b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45933 } } }
I20260812 06:27:40.866266 5516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:40.866472 5514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a9615e9521141d5a9c8f9721c649b7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a9615e9521141d5a9c8f9721c649b7b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45933 } } }
I20260812 06:27:40.866559 5527 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:40.866600 5514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:40.867066 5527 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:40.868070 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 5376
I20260812 06:27:40.868201 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:40.868429 30781 external_mini_cluster.cc:1428] Setting key a4c7c2b753e4ee95a85fba0ee74d194e
I20260812 06:27:40.872783 5527 catalog_manager.cc:1347] Generated new cluster ID: 38a7f4f176e64824b175c8ebfcd6ef14
I20260812 06:27:40.872836 5527 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:40.873333 5541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:40.868851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40459 (local address 127.0.0.1:45933)
0812 06:27:40.869005 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:40.869012 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:40.869035 (+ 23us) server_negotiation.cc:407] Connection header received
0812 06:27:40.869122 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:40.869128 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:40.869167 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:40.869266 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:40.869476 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:40.870361 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:40.871490 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:40.871890 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:40.871967 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:40.872624 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:40.872627 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:40.872628 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:40.872819 (+ 191us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:40.872858 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:40.872872 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:40.872952 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:40.873097 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 06:27:40.873131 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":71,"threads_started":1}
I20260812 06:27:40.874358 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:40.879449 5541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:40.875903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41591 (local address 127.0.0.1:45933)
0812 06:27:40.875937 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:40.875938 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:40.876044 (+ 106us) server_negotiation.cc:407] Connection header received
0812 06:27:40.876145 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:40.876146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:40.876156 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:40.876184 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:40.876376 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:40.877096 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:40.878126 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:40.878438 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:40.878473 (+ 35us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:40.879156 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:40.879157 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:40.879157 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:40.879161 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:40.879174 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:40.879178 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:40.879209 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:40.879366 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 06:27:40.879378 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:27:40.882273 5527 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:40.882727 5527 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:40.899989 5527 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a9615e9521141d5a9c8f9721c649b7b: Generated new TSK 0
I20260812 06:27:40.900170 5527 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:40.906263 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 5376
W20260812 06:27:40.923561 5346 connection.cc:535] client connection to 127.0.0.1:45933 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45933): Connection reset by peer (error 104)
2026-08-12T06:27:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1489 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:40 dist-test-slave-gjrz krb5kdc[5559](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:40 dist-test-slave-gjrz krb5kdc[5559](info): set up 2 sockets
Aug 12 06:27:40 dist-test-slave-gjrz krb5kdc[5559](info): commencing operation
krb5kdc: starting...
W20260812 06:27:42.107667 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:42 dist-test-slave-gjrz krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:27:42.219938 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42251
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:42.298228 5584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:42.298406 5584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:42.298426 5584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:42.299567 5584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:42.299606 5584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:42.299618 5584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:42.299641 5584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:42.299666 5584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:42.301097 5584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42251
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:42.301311 5584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:42.301527 5584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:42.306133 5602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:42.306221 5597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:42.306173 5595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:42.306366 5584 server_base.cc:1034] running on GCE node
I20260812 06:27:42.306588 5584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:42.306844 5584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:42.307988 5584 hybrid_clock.cc:648] HybridClock initialized: now 1786516062307973 us; error 28 us; skew 500 ppm
Aug 12 06:27:42 dist-test-slave-gjrz krb5kdc[5559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516062, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:42.310180 5584 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:27:42.310528 5584 webserver.cc:460] Webserver started at http://127.0.0.1:38855/ using document root <none> and password file <none>
I20260812 06:27:42.310709 5584 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:42.310747 5584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:42.310830 5584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:42.311781 5584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "8055dff327d8483a8edbb18877356f81"
format_stamp: "Formatted at 2026-08-12 06:27:42 on dist-test-slave-gjrz"
server_key: "02ba61fbb7435a6e9c554e95cddb1dff"
server_key_iv: "de8aba9257033448b9988fa27414a7cb"
server_key_version: "encryptionkey@0"
I20260812 06:27:42.312058 5584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "8055dff327d8483a8edbb18877356f81"
format_stamp: "Formatted at 2026-08-12 06:27:42 on dist-test-slave-gjrz"
server_key: "02ba61fbb7435a6e9c554e95cddb1dff"
server_key_iv: "de8aba9257033448b9988fa27414a7cb"
server_key_version: "encryptionkey@0"
I20260812 06:27:42.313162 5584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:27:42.313779 5613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:42.313920 5584 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:42.313992 5584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "8055dff327d8483a8edbb18877356f81"
format_stamp: "Formatted at 2026-08-12 06:27:42 on dist-test-slave-gjrz"
server_key: "02ba61fbb7435a6e9c554e95cddb1dff"
server_key_iv: "de8aba9257033448b9988fa27414a7cb"
server_key_version: "encryptionkey@0"
I20260812 06:27:42.314059 5584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:42.317175 5584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:42.318811 5584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:42.318940 5584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:42.322567 5584 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42251
I20260812 06:27:42.322629 5709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42251 every 8 connection(s)
I20260812 06:27:42.322880 5584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:42.323697 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 5584
I20260812 06:27:42.323783 5711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:42.323802 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:42.323971 30781 external_mini_cluster.cc:1428] Setting key 28904bd19d697044b67f64bfe7f137d5
I20260812 06:27:42.326303 5719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:42.324412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34873 (local address 127.0.0.1:42251)
0812 06:27:42.324676 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:42.324684 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:42.324717 (+ 33us) server_negotiation.cc:407] Connection header received
0812 06:27:42.325163 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:42.325173 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:42.325206 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:42.325350 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:42.325893 (+ 543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:42.325896 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:42.325896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:42.325900 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:42.325945 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:42.325959 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:42.326027 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:42.326097 (+ 70us) server_negotiation.cc:299] Negotiation successful
0812 06:27:42.326135 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":71,"threads_started":1}
I20260812 06:27:42.326867 5711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81: Bootstrap starting.
I20260812 06:27:42.327297 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:42.327538 5711 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:42.327803 5711 log.cc:824] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:42.328441 5711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81: No bootstrap required, opened a new log
I20260812 06:27:42.330163 5711 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8055dff327d8483a8edbb18877356f81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } }
I20260812 06:27:42.330283 5711 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:42.330313 5711 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8055dff327d8483a8edbb18877356f81, State: Initialized, Role: FOLLOWER
I20260812 06:27:42.330427 5711 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8055dff327d8483a8edbb18877356f81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } }
I20260812 06:27:42.330495 5711 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:42.330519 5711 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:42.330572 5711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:42.331058 5711 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8055dff327d8483a8edbb18877356f81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } }
I20260812 06:27:42.331144 5711 leader_election.cc:302] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8055dff327d8483a8edbb18877356f81; no voters:
I20260812 06:27:42.331346 5711 leader_election.cc:288] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:42.331380 5728 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:42.331521 5728 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [term 1 LEADER]: Becoming Leader. State: Replica: 8055dff327d8483a8edbb18877356f81, State: Running, Role: LEADER
I20260812 06:27:42.331568 5711 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:42.331606 5728 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8055dff327d8483a8edbb18877356f81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } }
I20260812 06:27:42.331954 5731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8055dff327d8483a8edbb18877356f81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8055dff327d8483a8edbb18877356f81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } } }
I20260812 06:27:42.331959 5732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8055dff327d8483a8edbb18877356f81. Latest consensus state: current_term: 1 leader_uuid: "8055dff327d8483a8edbb18877356f81" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8055dff327d8483a8edbb18877356f81" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42251 } } }
I20260812 06:27:42.332109 5731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:42.332118 5732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:42.332532 5740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:42.333021 5740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:42.334470 5740 catalog_manager.cc:1347] Generated new cluster ID: df1827f108c14d1a976fd6eb432f4286
I20260812 06:27:42.334519 5740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:42.342538 5740 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:42.342684 5740 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:42.343346 5719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:42.332982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54745 (local address 127.0.0.1:42251)
0812 06:27:42.333041 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:42.333043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:42.342407 (+ 9364us) server_negotiation.cc:407] Connection header received
0812 06:27:42.342435 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:42.342436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:42.342454 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:42.342520 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:42.343134 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:42.343136 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:42.343136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:42.343140 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:42.343154 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:42.343158 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:42.343205 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:42.343255 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 06:27:42.343286 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:27:42.347365 5740 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8055dff327d8483a8edbb18877356f81: Generated new TSK 0
I20260812 06:27:42.347523 5740 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:42.351758 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 5584
2026-08-12T06:27:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1440 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:42 dist-test-slave-gjrz krb5kdc[5767](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:42 dist-test-slave-gjrz krb5kdc[5767](info): set up 2 sockets
Aug 12 06:27:42 dist-test-slave-gjrz krb5kdc[5767](info): commencing operation
krb5kdc: starting...
W20260812 06:27:43.541546 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:43 dist-test-slave-gjrz krb5kdc[5767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:27:43.649830 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37953
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37953
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:43.727928 5791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:43.728118 5791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:43.728139 5791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:43.729238 5791 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:43.729277 5791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:43.729290 5791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:43.729313 5791 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:43.729329 5791 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:43.730757 5791 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:43.730978 5791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:43.731189 5791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:43.735703 5812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:43.735689 5816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:43.735708 5811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:43.735737 5791 server_base.cc:1034] running on GCE node
I20260812 06:27:43.736132 5791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:43.736377 5791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:43.737514 5791 hybrid_clock.cc:648] HybridClock initialized: now 1786516063737498 us; error 27 us; skew 500 ppm
Aug 12 06:27:43 dist-test-slave-gjrz krb5kdc[5767](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516063, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:43.739863 5791 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:27:43.740233 5791 webserver.cc:460] Webserver started at http://127.0.0.1:43601/ using document root <none> and password file <none>
I20260812 06:27:43.740417 5791 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:43.740454 5791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:43.740541 5791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:43.741487 5791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "b4c0b1f647994b319dcea9eb36bbf160"
format_stamp: "Formatted at 2026-08-12 06:27:43 on dist-test-slave-gjrz"
server_key: "246a1ce4463dae90e59752c2c23e3e3a"
server_key_iv: "08a38844afc2536aaa0a8b1c35ec63e4"
server_key_version: "encryptionkey@0"
I20260812 06:27:43.741766 5791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "b4c0b1f647994b319dcea9eb36bbf160"
format_stamp: "Formatted at 2026-08-12 06:27:43 on dist-test-slave-gjrz"
server_key: "246a1ce4463dae90e59752c2c23e3e3a"
server_key_iv: "08a38844afc2536aaa0a8b1c35ec63e4"
server_key_version: "encryptionkey@0"
I20260812 06:27:43.742933 5791 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:27:43.743605 5830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:43.743752 5791 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:43.743824 5791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "b4c0b1f647994b319dcea9eb36bbf160"
format_stamp: "Formatted at 2026-08-12 06:27:43 on dist-test-slave-gjrz"
server_key: "246a1ce4463dae90e59752c2c23e3e3a"
server_key_iv: "08a38844afc2536aaa0a8b1c35ec63e4"
server_key_version: "encryptionkey@0"
I20260812 06:27:43.743889 5791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:43.752103 5791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:43.753772 5791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:43.753885 5791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:43.757509 5791 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37953
I20260812 06:27:43.757543 5942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37953 every 8 connection(s)
I20260812 06:27:43.757824 5791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:43.758626 5944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:43.760802 5944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160: Bootstrap starting.
I20260812 06:27:43.761307 5944 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:43.761541 5944 log.cc:824] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:43.762156 5944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160: No bootstrap required, opened a new log
I20260812 06:27:43.763710 5944 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4c0b1f647994b319dcea9eb36bbf160" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37953 } }
I20260812 06:27:43.763880 5944 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:43.763911 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 5791
I20260812 06:27:43.763926 5944 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4c0b1f647994b319dcea9eb36bbf160, State: Initialized, Role: FOLLOWER
I20260812 06:27:43.764036 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:43.764074 5944 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4c0b1f647994b319dcea9eb36bbf160" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37953 } }
I20260812 06:27:43.764161 5944 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:43.764199 5944 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:43.764240 30781 external_mini_cluster.cc:1428] Setting key 0e4036ce6c1784bacfbd78e8e8141410
I20260812 06:27:43.764243 5944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:43.764842 5944 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4c0b1f647994b319dcea9eb36bbf160" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37953 } }
I20260812 06:27:43.764948 5944 leader_election.cc:302] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4c0b1f647994b319dcea9eb36bbf160; no voters:
I20260812 06:27:43.765116 5944 leader_election.cc:288] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:43.765151 5952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:43.765251 5952 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [term 1 LEADER]: Becoming Leader. State: Replica: b4c0b1f647994b319dcea9eb36bbf160, State: Running, Role: LEADER
I20260812 06:27:43.765374 5944 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:43.765389 5952 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4c0b1f647994b319dcea9eb36bbf160" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37953 } }
I20260812 06:27:43.765767 5953 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4c0b1f647994b319dcea9eb36bbf160" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4c0b1f647994b319dcea9eb36bbf160" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37953 } } }
I20260812 06:27:43.765851 5953 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:43.766048 5972 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:43.766149 5952 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4c0b1f647994b319dcea9eb36bbf160. Latest consensus state: current_term: 1 leader_uuid: "b4c0b1f647994b319dcea9eb36bbf160" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4c0b1f647994b319dcea9eb36bbf160" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37953 } } }
I20260812 06:27:43.766680 5972 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:43.766691 5952 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:43.768107 5972 catalog_manager.cc:1347] Generated new cluster ID: 4420c2e43aa947869966c0e920e788a1
I20260812 06:27:43.768157 5972 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:27:43 dist-test-slave-gjrz krb5kdc[5767](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 06:27:43.777393 5972 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:43.778030 5972 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:43.780333 5950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:43.764937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55583 (local address 127.0.0.1:37953)
0812 06:27:43.765104 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:43.765112 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:43.765136 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:27:43.765242 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:43.765250 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:43.765303 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:43.766230 (+ 927us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:43.766346 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:43.767873 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:43.768710 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:43.769121 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:43.769222 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:43.777315 (+ 8093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:43.777319 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:43.777319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:43.777330 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:43.778885 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:43.779207 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:43.779210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:43.779210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:43.779331 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:43.779513 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:43.779514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:43.779514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:43.779732 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:43.779863 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:43.779972 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 06:27:43.780124 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260812 06:27:43.781090 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:43.787568 5950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:43.782293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40011 (local address 127.0.0.1:37953)
0812 06:27:43.782328 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:43.782329 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:43.782466 (+ 137us) server_negotiation.cc:407] Connection header received
0812 06:27:43.782493 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:43.782493 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:43.782502 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:43.782547 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:43.783012 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:43.783539 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:43.784234 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:43.784436 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:43.784489 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:43.785476 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:43.785477 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:43.785478 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:43.785484 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:43.786623 (+ 1139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:43.786913 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:43.786914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:43.786914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:43.786963 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:43.787127 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:43.787127 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:43.787128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:43.787226 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:43.787344 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:43.787423 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 06:27:43.787491 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:27:43.805836 5972 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4c0b1f647994b319dcea9eb36bbf160: Generated new TSK 0
I20260812 06:27:43.806002 5972 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:43.808882 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 5791
2026-08-12T06:27:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1475 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:43 dist-test-slave-gjrz krb5kdc[6004](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:43 dist-test-slave-gjrz krb5kdc[6004](info): set up 2 sockets
Aug 12 06:27:43 dist-test-slave-gjrz krb5kdc[6004](info): commencing operation
krb5kdc: starting...
W20260812 06:27:45.022202 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:45 dist-test-slave-gjrz krb5kdc[6004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:27:45.132215 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33469
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:45.211369 6025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:45.211556 6025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:45.211577 6025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:45.212682 6025 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:45.212720 6025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:45.212733 6025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:45.212744 6025 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:45.212764 6025 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:45.214178 6025 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:45.214389 6025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:45.214588 6025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:45.219097 6038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:45.219159 6039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:45.219169 6046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:45.219295 6025 server_base.cc:1034] running on GCE node
I20260812 06:27:45.219561 6025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:45.219825 6025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:45.220966 6025 hybrid_clock.cc:648] HybridClock initialized: now 1786516065220948 us; error 33 us; skew 500 ppm
Aug 12 06:27:45 dist-test-slave-gjrz krb5kdc[6004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516065, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:45.225859 6025 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:27:45.226281 6025 webserver.cc:460] Webserver started at http://127.0.0.1:37975/ using document root <none> and password file <none>
I20260812 06:27:45.226467 6025 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:45.226511 6025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:45.226626 6025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:45.227658 6025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "45e7cef7685a4f64a32bc803ec420aed"
format_stamp: "Formatted at 2026-08-12 06:27:45 on dist-test-slave-gjrz"
server_key: "719d98d4f305eb726d65ef31530098e6"
server_key_iv: "ec8497c2a5f7d073af521b6c3a21a8bc"
server_key_version: "encryptionkey@0"
I20260812 06:27:45.227979 6025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "45e7cef7685a4f64a32bc803ec420aed"
format_stamp: "Formatted at 2026-08-12 06:27:45 on dist-test-slave-gjrz"
server_key: "719d98d4f305eb726d65ef31530098e6"
server_key_iv: "ec8497c2a5f7d073af521b6c3a21a8bc"
server_key_version: "encryptionkey@0"
I20260812 06:27:45.229197 6025 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260812 06:27:45.229825 6063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:45.229980 6025 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:45.230070 6025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "45e7cef7685a4f64a32bc803ec420aed"
format_stamp: "Formatted at 2026-08-12 06:27:45 on dist-test-slave-gjrz"
server_key: "719d98d4f305eb726d65ef31530098e6"
server_key_iv: "ec8497c2a5f7d073af521b6c3a21a8bc"
server_key_version: "encryptionkey@0"
I20260812 06:27:45.230131 6025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:45.258635 6025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:45.260416 6025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:45.260555 6025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:45.264436 6025 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33469
I20260812 06:27:45.264477 6165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33469 every 8 connection(s)
I20260812 06:27:45.264797 6025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:45.265647 6166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:45.266549 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 6025
I20260812 06:27:45.266673 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:45.266877 30781 external_mini_cluster.cc:1428] Setting key 5bb7b2fed92fc158474fc51b792ab2cc
I20260812 06:27:45.268342 6166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed: Bootstrap starting.
I20260812 06:27:45.268970 6166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:45.269233 6166 log.cc:824] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:45.269906 6166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed: No bootstrap required, opened a new log
I20260812 06:27:45.271756 6166 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45e7cef7685a4f64a32bc803ec420aed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33469 } }
I20260812 06:27:45.271884 6166 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:45.271907 6166 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45e7cef7685a4f64a32bc803ec420aed, State: Initialized, Role: FOLLOWER
I20260812 06:27:45.272074 6166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45e7cef7685a4f64a32bc803ec420aed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33469 } }
I20260812 06:27:45.272156 6166 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:45.272189 6166 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:45.272233 6166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:45.272239 6174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:45.267399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60715 (local address 127.0.0.1:33469)
0812 06:27:45.267575 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:45.267582 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:45.267608 (+ 26us) server_negotiation.cc:407] Connection header received
0812 06:27:45.268179 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:45.268186 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:45.268234 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:45.268346 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:45.268594 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:45.269617 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:45.270447 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:45.270865 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:45.270961 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:45.271598 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:45.271602 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:45.271602 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:45.271757 (+ 155us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:45.271788 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:45.271798 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:45.271851 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:45.271969 (+ 118us) server_negotiation.cc:299] Negotiation successful
0812 06:27:45.272035 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260812 06:27:45.272732 6166 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45e7cef7685a4f64a32bc803ec420aed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33469 } }
I20260812 06:27:45.272827 6166 leader_election.cc:302] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45e7cef7685a4f64a32bc803ec420aed; no voters:
I20260812 06:27:45.272990 6166 leader_election.cc:288] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:45.273020 6178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:45.273211 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:45.273201 6178 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [term 1 LEADER]: Becoming Leader. State: Replica: 45e7cef7685a4f64a32bc803ec420aed, State: Running, Role: LEADER
I20260812 06:27:45.273216 6166 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:45.273313 6178 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45e7cef7685a4f64a32bc803ec420aed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33469 } }
I20260812 06:27:45.273648 6178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45e7cef7685a4f64a32bc803ec420aed. Latest consensus state: current_term: 1 leader_uuid: "45e7cef7685a4f64a32bc803ec420aed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45e7cef7685a4f64a32bc803ec420aed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33469 } } }
I20260812 06:27:45.273710 6178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:45.273699 6182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45e7cef7685a4f64a32bc803ec420aed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45e7cef7685a4f64a32bc803ec420aed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33469 } } }
I20260812 06:27:45.273783 6182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:45.273954 6188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:45.274428 6188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:45.275974 6188 catalog_manager.cc:1347] Generated new cluster ID: be88b03f98ef47f59091051e894cbb8e
I20260812 06:27:45.276024 6188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:45.278172 6174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:45.274878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42281 (local address 127.0.0.1:33469)
0812 06:27:45.274910 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:45.274912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:45.275054 (+ 142us) server_negotiation.cc:407] Connection header received
0812 06:27:45.275097 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:45.275097 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:45.275107 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:45.275170 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:45.275257 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:45.275925 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:45.276924 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:45.277209 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:45.277250 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:45.277916 (+ 666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:45.277917 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:45.277917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:45.277922 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:45.277934 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:45.277938 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:45.277963 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:45.278082 (+ 119us) server_negotiation.cc:299] Negotiation successful
0812 06:27:45.278102 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:27:45.282737 6188 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:45.283353 6188 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:45.293424 6188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45e7cef7685a4f64a32bc803ec420aed: Generated new TSK 0
I20260812 06:27:45.293581 6188 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:45.295511 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 6025
2026-08-12T06:27:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1475 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:45 dist-test-slave-gjrz krb5kdc[6214](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:45 dist-test-slave-gjrz krb5kdc[6214](info): set up 2 sockets
Aug 12 06:27:45 dist-test-slave-gjrz krb5kdc[6214](info): commencing operation
krb5kdc: starting...
W20260812 06:27:46.496017 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:46 dist-test-slave-gjrz krb5kdc[6214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:27:46.610114 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39857
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39857
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:46.688685 6243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:46.688867 6243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:46.688887 6243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:46.689930 6243 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:46.689968 6243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:46.689981 6243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:46.689992 6243 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:46.690006 6243 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:46.691381 6243 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39857
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:46.691561 6243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:46.691718 6243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:46.696203 6267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:46.696218 6263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:46.696283 6269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:46.696249 6243 server_base.cc:1034] running on GCE node
I20260812 06:27:46.696573 6243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:46.696822 6243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:46.697988 6243 hybrid_clock.cc:648] HybridClock initialized: now 1786516066697973 us; error 31 us; skew 500 ppm
Aug 12 06:27:46 dist-test-slave-gjrz krb5kdc[6214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516066, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:46.700321 6243 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:27:46.700721 6243 webserver.cc:460] Webserver started at http://127.0.0.1:41947/ using document root <none> and password file <none>
I20260812 06:27:46.700917 6243 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:46.700992 6243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:46.701114 6243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:46.702075 6243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "62bd7bc91c2e4f1bbdfb7aae7b9871c1"
format_stamp: "Formatted at 2026-08-12 06:27:46 on dist-test-slave-gjrz"
server_key: "248ec24bfa8d40419f69de65e85b6fc4"
server_key_iv: "4b5579ed70c297db655e2980c07d66bc"
server_key_version: "encryptionkey@0"
I20260812 06:27:46.702394 6243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "62bd7bc91c2e4f1bbdfb7aae7b9871c1"
format_stamp: "Formatted at 2026-08-12 06:27:46 on dist-test-slave-gjrz"
server_key: "248ec24bfa8d40419f69de65e85b6fc4"
server_key_iv: "4b5579ed70c297db655e2980c07d66bc"
server_key_version: "encryptionkey@0"
I20260812 06:27:46.703675 6243 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:27:46.704311 6283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:46.704465 6243 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:46.704545 6243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "62bd7bc91c2e4f1bbdfb7aae7b9871c1"
format_stamp: "Formatted at 2026-08-12 06:27:46 on dist-test-slave-gjrz"
server_key: "248ec24bfa8d40419f69de65e85b6fc4"
server_key_iv: "4b5579ed70c297db655e2980c07d66bc"
server_key_version: "encryptionkey@0"
I20260812 06:27:46.704603 6243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:46.707736 6243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:46.709641 6243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:46.709764 6243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:46.713413 6243 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39857
I20260812 06:27:46.713445 6388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39857 every 8 connection(s)
I20260812 06:27:46.713733 6243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:46.714480 6389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:46.716605 6389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1: Bootstrap starting.
I20260812 06:27:46.717140 6389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:46.717392 6389 log.cc:824] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:46.718014 6389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1: No bootstrap required, opened a new log
I20260812 06:27:46.719601 6389 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62bd7bc91c2e4f1bbdfb7aae7b9871c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39857 } }
I20260812 06:27:46.719729 6389 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:46.719750 6389 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62bd7bc91c2e4f1bbdfb7aae7b9871c1, State: Initialized, Role: FOLLOWER
I20260812 06:27:46.719887 6389 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62bd7bc91c2e4f1bbdfb7aae7b9871c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39857 } }
I20260812 06:27:46.719949 6389 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:46.719969 6389 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:46.720014 6389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:46.720489 6389 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62bd7bc91c2e4f1bbdfb7aae7b9871c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39857 } }
I20260812 06:27:46.720578 6389 leader_election.cc:302] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62bd7bc91c2e4f1bbdfb7aae7b9871c1; no voters:
I20260812 06:27:46.720724 6389 leader_election.cc:288] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:46.720763 6395 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:46.720922 6395 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [term 1 LEADER]: Becoming Leader. State: Replica: 62bd7bc91c2e4f1bbdfb7aae7b9871c1, State: Running, Role: LEADER
I20260812 06:27:46.720961 6389 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:46.721009 6395 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62bd7bc91c2e4f1bbdfb7aae7b9871c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39857 } }
I20260812 06:27:46.721352 6398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62bd7bc91c2e4f1bbdfb7aae7b9871c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62bd7bc91c2e4f1bbdfb7aae7b9871c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39857 } } }
I20260812 06:27:46.721365 6403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62bd7bc91c2e4f1bbdfb7aae7b9871c1. Latest consensus state: current_term: 1 leader_uuid: "62bd7bc91c2e4f1bbdfb7aae7b9871c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62bd7bc91c2e4f1bbdfb7aae7b9871c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39857 } } }
I20260812 06:27:46.721509 6398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:46.721566 6403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:46.721894 6412 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:46.722395 6412 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:46.723850 6412 catalog_manager.cc:1347] Generated new cluster ID: fe08427e10a64103bdde3a1181902f64
I20260812 06:27:46.723852 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 6243
I20260812 06:27:46.723899 6412 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:46.723953 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:46.724154 30781 external_mini_cluster.cc:1428] Setting key 0ea4e861d0a76a6bb543f44fc27145ee
I20260812 06:27:46.730358 6436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:46.724731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54311 (local address 127.0.0.1:39857)
0812 06:27:46.728887 (+ 4156us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:46.728895 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:46.728924 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:27:46.729027 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:46.729033 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:46.729061 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:46.729188 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:46.729870 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:46.729873 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:46.729874 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:46.729877 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:46.729913 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:46.729926 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:46.729983 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:46.730057 (+ 74us) server_negotiation.cc:299] Negotiation successful
0812 06:27:46.730173 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4117,"thread_start_us":62,"threads_started":1}
I20260812 06:27:46.731231 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:46.740490 6436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:46.739529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46533 (local address 127.0.0.1:39857)
0812 06:27:46.739578 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:46.739579 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:46.739678 (+ 99us) server_negotiation.cc:407] Connection header received
0812 06:27:46.739737 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:46.739738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:46.739743 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:46.739787 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:46.740302 (+ 515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:46.740303 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:46.740303 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:46.740307 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:46.740321 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:46.740325 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:46.740372 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:46.740414 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 06:27:46.740425 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260812 06:27:46.755723 6412 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:46.755882 6412 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:46.760658 6412 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62bd7bc91c2e4f1bbdfb7aae7b9871c1: Generated new TSK 0
I20260812 06:27:46.760820 6412 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:46.766023 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 6243
2026-08-12T06:27:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1473 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:46 dist-test-slave-gjrz krb5kdc[6451](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:46 dist-test-slave-gjrz krb5kdc[6451](info): set up 2 sockets
Aug 12 06:27:46 dist-test-slave-gjrz krb5kdc[6451](info): commencing operation
krb5kdc: starting...
W20260812 06:27:47.971745 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:48 dist-test-slave-gjrz krb5kdc[6451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:27:48.085780 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39355
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:48.165162 6472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:48.165344 6472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:48.165365 6472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:48.166466 6472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:48.166507 6472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:48.166520 6472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:48.166543 6472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:48.166559 6472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:48.168025 6472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:48.168238 6472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:48.168429 6472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:48.172927 6478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:48.172925 6480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:48.173092 6486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:48.173218 6472 server_base.cc:1034] running on GCE node
I20260812 06:27:48.173426 6472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:48.173720 6472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:48.174854 6472 hybrid_clock.cc:648] HybridClock initialized: now 1786516068174838 us; error 33 us; skew 500 ppm
Aug 12 06:27:48 dist-test-slave-gjrz krb5kdc[6451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516068, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:48.177204 6472 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:27:48.177631 6472 webserver.cc:460] Webserver started at http://127.0.0.1:32953/ using document root <none> and password file <none>
I20260812 06:27:48.177830 6472 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:48.177875 6472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:48.177996 6472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:48.178960 6472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "681f13c447c244e9b758cb5c9bd9f807"
format_stamp: "Formatted at 2026-08-12 06:27:48 on dist-test-slave-gjrz"
server_key: "2e159429d2315d4319b7b0cd49800952"
server_key_iv: "3352945598dd801e8b9278cd61a3a5b3"
server_key_version: "encryptionkey@0"
I20260812 06:27:48.179320 6472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "681f13c447c244e9b758cb5c9bd9f807"
format_stamp: "Formatted at 2026-08-12 06:27:48 on dist-test-slave-gjrz"
server_key: "2e159429d2315d4319b7b0cd49800952"
server_key_iv: "3352945598dd801e8b9278cd61a3a5b3"
server_key_version: "encryptionkey@0"
I20260812 06:27:48.180521 6472 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260812 06:27:48.181142 6501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:48.181294 6472 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:48.181376 6472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "681f13c447c244e9b758cb5c9bd9f807"
format_stamp: "Formatted at 2026-08-12 06:27:48 on dist-test-slave-gjrz"
server_key: "2e159429d2315d4319b7b0cd49800952"
server_key_iv: "3352945598dd801e8b9278cd61a3a5b3"
server_key_version: "encryptionkey@0"
I20260812 06:27:48.181442 6472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:48.188656 6472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:48.190557 6472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:48.190678 6472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:48.194366 6472 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39355
I20260812 06:27:48.194394 6611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39355 every 8 connection(s)
I20260812 06:27:48.194687 6472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:48.195505 6613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:48.197571 6613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807: Bootstrap starting.
I20260812 06:27:48.198123 6613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:48.198376 6613 log.cc:824] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:48.199091 6613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807: No bootstrap required, opened a new log
I20260812 06:27:48.199846 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 6472
I20260812 06:27:48.199968 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:48.200130 30781 external_mini_cluster.cc:1428] Setting key 043fbe03f81b7769339d9ae763aa2378
I20260812 06:27:48.201028 6613 raft_consensus.cc:348] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681f13c447c244e9b758cb5c9bd9f807" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39355 } }
I20260812 06:27:48.201195 6613 raft_consensus.cc:374] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:48.201232 6613 raft_consensus.cc:729] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 681f13c447c244e9b758cb5c9bd9f807, State: Initialized, Role: FOLLOWER
I20260812 06:27:48.201385 6613 consensus_queue.cc:260] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681f13c447c244e9b758cb5c9bd9f807" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39355 } }
I20260812 06:27:48.201449 6613 raft_consensus.cc:388] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:48.201470 6613 raft_consensus.cc:482] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:48.201496 6613 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:48.202541 6613 raft_consensus.cc:504] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681f13c447c244e9b758cb5c9bd9f807" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39355 } }
I20260812 06:27:48.202646 6613 leader_election.cc:302] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 681f13c447c244e9b758cb5c9bd9f807; no voters:
I20260812 06:27:48.202788 6613 leader_election.cc:288] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:48.202839 6621 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:48.203004 6613 sys_catalog.cc:564] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:48.203027 6621 raft_consensus.cc:686] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [term 1 LEADER]: Becoming Leader. State: Replica: 681f13c447c244e9b758cb5c9bd9f807, State: Running, Role: LEADER
I20260812 06:27:48.203368 6621 consensus_queue.cc:237] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681f13c447c244e9b758cb5c9bd9f807" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39355 } }
I20260812 06:27:48.203790 6623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "681f13c447c244e9b758cb5c9bd9f807" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681f13c447c244e9b758cb5c9bd9f807" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39355 } } }
I20260812 06:27:48.203864 6623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:48.204020 6624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 681f13c447c244e9b758cb5c9bd9f807. Latest consensus state: current_term: 1 leader_uuid: "681f13c447c244e9b758cb5c9bd9f807" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681f13c447c244e9b758cb5c9bd9f807" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39355 } } }
I20260812 06:27:48.204089 6624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:48.204208 6641 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:48.204721 6641 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:48.206555 6641 catalog_manager.cc:1347] Generated new cluster ID: 625a2c0fce0b43b689e34bc6a0c3769c
I20260812 06:27:48.206610 6641 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:27:48 dist-test-slave-gjrz krb5kdc[6451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 06:27:48.210345 6620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:48.200588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:45795 (local address 127.0.0.1:39355)
0812 06:27:48.200764 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:48.200773 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:48.200808 (+ 35us) server_negotiation.cc:407] Connection header received
0812 06:27:48.201007 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:48.201014 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:48.201073 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:48.201215 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:48.201848 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:48.203251 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:48.204321 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:48.204920 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:48.205022 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:48.207319 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:48.207322 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:48.207323 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:48.207334 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:48.208751 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:48.209110 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:48.209113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:48.209113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:48.209222 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:48.209431 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:48.209431 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:48.209432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:48.209657 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:48.209809 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:48.209933 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 06:27:48.210029 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260812 06:27:48.211225 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:48.218050 6620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:48.212617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:42213 (local address 127.0.0.1:39355)
0812 06:27:48.212649 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:48.212651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:48.212830 (+ 179us) server_negotiation.cc:407] Connection header received
0812 06:27:48.212880 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:48.212881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:48.212891 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:48.212942 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:48.213411 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:48.213891 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:48.214543 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:48.214753 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:48.214808 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:48.215860 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:48.215862 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:48.215862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:48.215868 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:48.217049 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:48.217373 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:48.217374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:48.217374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:48.217422 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:48.217615 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:48.217616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:48.217616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:48.217712 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:48.217807 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:48.217917 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 06:27:48.217973 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 06:27:48.242885 6641 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:48.243580 6641 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:48.247408 6641 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 681f13c447c244e9b758cb5c9bd9f807: Generated new TSK 0
I20260812 06:27:48.247574 6641 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:48.252323 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 6472
W20260812 06:27:48.268137 6449 connection.cc:535] client connection to 127.0.0.1:39355 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39355): Connection reset by peer (error 104)
2026-08-12T06:27:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1478 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:48 dist-test-slave-gjrz krb5kdc[6675](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:48 dist-test-slave-gjrz krb5kdc[6675](info): set up 2 sockets
Aug 12 06:27:48 dist-test-slave-gjrz krb5kdc[6675](info): commencing operation
krb5kdc: starting...
W20260812 06:27:49.439119 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:49 dist-test-slave-gjrz krb5kdc[6675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516069, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:27:49.549690 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37607
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37607
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:49.628335 6701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:49.628520 6701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:49.628540 6701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:49.629639 6701 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:49.629683 6701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:49.629695 6701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:49.629709 6701 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:49.629733 6701 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:49.631170 6701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:49.631407 6701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:49.631608 6701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:49.636078 6727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:49.636143 6701 server_base.cc:1034] running on GCE node
W20260812 06:27:49.636096 6718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:49.636091 6720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:49.636521 6701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:49.636801 6701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:49.637965 6701 hybrid_clock.cc:648] HybridClock initialized: now 1786516069637945 us; error 34 us; skew 500 ppm
Aug 12 06:27:49 dist-test-slave-gjrz krb5kdc[6675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516069, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:49.640316 6701 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:27:49.640741 6701 webserver.cc:460] Webserver started at http://127.0.0.1:35925/ using document root <none> and password file <none>
I20260812 06:27:49.640936 6701 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:49.640978 6701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:49.641093 6701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:49.642105 6701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "f70049eb39e84ebf92e6054837031351"
format_stamp: "Formatted at 2026-08-12 06:27:49 on dist-test-slave-gjrz"
server_key: "cdcca81c0050d0804cf68b7ce21fff97"
server_key_iv: "495eaa9b8e6875dfa82036cf7daa5ee6"
server_key_version: "encryptionkey@0"
I20260812 06:27:49.642433 6701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "f70049eb39e84ebf92e6054837031351"
format_stamp: "Formatted at 2026-08-12 06:27:49 on dist-test-slave-gjrz"
server_key: "cdcca81c0050d0804cf68b7ce21fff97"
server_key_iv: "495eaa9b8e6875dfa82036cf7daa5ee6"
server_key_version: "encryptionkey@0"
I20260812 06:27:49.643710 6701 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:27:49.644403 6738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:49.644546 6701 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:27:49.644622 6701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "f70049eb39e84ebf92e6054837031351"
format_stamp: "Formatted at 2026-08-12 06:27:49 on dist-test-slave-gjrz"
server_key: "cdcca81c0050d0804cf68b7ce21fff97"
server_key_iv: "495eaa9b8e6875dfa82036cf7daa5ee6"
server_key_version: "encryptionkey@0"
I20260812 06:27:49.644685 6701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:49.660408 6701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:49.662113 6701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:49.662223 6701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:49.665979 6701 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37607
I20260812 06:27:49.666020 6839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37607 every 8 connection(s)
I20260812 06:27:49.666306 6701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:49.667129 6843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:49.669255 6843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351: Bootstrap starting.
I20260812 06:27:49.669760 6843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:49.669987 6843 log.cc:824] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:49.670606 6843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351: No bootstrap required, opened a new log
I20260812 06:27:49.672181 6843 raft_consensus.cc:348] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70049eb39e84ebf92e6054837031351" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37607 } }
I20260812 06:27:49.672312 6843 raft_consensus.cc:374] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:49.672333 6843 raft_consensus.cc:729] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f70049eb39e84ebf92e6054837031351, State: Initialized, Role: FOLLOWER
I20260812 06:27:49.672426 6843 consensus_queue.cc:260] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70049eb39e84ebf92e6054837031351" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37607 } }
I20260812 06:27:49.672482 6843 raft_consensus.cc:388] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:49.672506 6843 raft_consensus.cc:482] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:49.672536 6843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:49.672974 6843 raft_consensus.cc:504] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70049eb39e84ebf92e6054837031351" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37607 } }
I20260812 06:27:49.673058 6843 leader_election.cc:302] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f70049eb39e84ebf92e6054837031351; no voters:
I20260812 06:27:49.673183 6843 leader_election.cc:288] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:49.673229 6846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:49.673390 6843 sys_catalog.cc:564] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:49.673425 6846 raft_consensus.cc:686] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [term 1 LEADER]: Becoming Leader. State: Replica: f70049eb39e84ebf92e6054837031351, State: Running, Role: LEADER
I20260812 06:27:49.673559 6846 consensus_queue.cc:237] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70049eb39e84ebf92e6054837031351" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37607 } }
I20260812 06:27:49.673663 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 6701
I20260812 06:27:49.673775 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:49.674006 30781 external_mini_cluster.cc:1428] Setting key e7e682362a7afaaa66dca156c835d5bd
I20260812 06:27:49.674069 6847 sys_catalog.cc:455] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f70049eb39e84ebf92e6054837031351" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70049eb39e84ebf92e6054837031351" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37607 } } }
I20260812 06:27:49.674141 6847 sys_catalog.cc:458] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:49.674490 6850 sys_catalog.cc:455] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f70049eb39e84ebf92e6054837031351. Latest consensus state: current_term: 1 leader_uuid: "f70049eb39e84ebf92e6054837031351" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f70049eb39e84ebf92e6054837031351" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37607 } } }
I20260812 06:27:49.674582 6850 sys_catalog.cc:458] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:49.674984 6860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:49.675494 6860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:49.677040 6860 catalog_manager.cc:1347] Generated new cluster ID: 44b3ce7d0c5e44d59dcf4abe4328b856
I20260812 06:27:49.677096 6860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:49.679828 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:49.674443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:44555 (local address 127.0.0.1:37607)
0812 06:27:49.674632 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:49.674640 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:49.674885 (+ 245us) server_negotiation.cc:407] Connection header received
0812 06:27:49.675007 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:49.675012 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:49.675056 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:49.675182 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:49.675482 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:49.676634 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:49.677758 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:49.678376 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:49.678491 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:49.679125 (+ 634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:49.679129 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:49.679129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:49.679365 (+ 236us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:49.679404 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:49.679420 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:49.679511 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:49.679593 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 06:27:49.679619 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":65,"threads_started":1}
I20260812 06:27:49.680719 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:49.685456 6870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:49.682292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:49495 (local address 127.0.0.1:37607)
0812 06:27:49.682342 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:49.682344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:49.682350 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:27:49.682368 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:49.682369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:49.682400 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:49.682451 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:49.682597 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:49.683303 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:49.684271 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:49.684595 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:49.684648 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:49.685230 (+ 582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:49.685231 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:49.685232 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:49.685236 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:49.685249 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:49.685253 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:49.685304 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:49.685373 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 06:27:49.685383 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260812 06:27:49.687739 6860 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:49.688378 6860 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:49.693243 6860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f70049eb39e84ebf92e6054837031351: Generated new TSK 0
I20260812 06:27:49.693397 6860 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:49.697680 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 6701
W20260812 06:27:49.711686 6671 connection.cc:535] client connection to 127.0.0.1:37607 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37607): Connection reset by peer (error 104)
2026-08-12T06:27:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1443 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:49 dist-test-slave-gjrz krb5kdc[6897](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:49 dist-test-slave-gjrz krb5kdc[6897](info): set up 2 sockets
Aug 12 06:27:49 dist-test-slave-gjrz krb5kdc[6897](info): commencing operation
krb5kdc: starting...
W20260812 06:27:50.895207 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:50 dist-test-slave-gjrz krb5kdc[6897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516070, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:27:51.005694 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43677
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:51.085870 6919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:51.086067 6919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:51.086098 6919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:51.087229 6919 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:51.087288 6919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:51.087311 6919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:51.087327 6919 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:51.087342 6919 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:51.088788 6919 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:51.089018 6919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:51.089231 6919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:51.093715 6931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:51.093717 6941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:51.094007 6919 server_base.cc:1034] running on GCE node
W20260812 06:27:51.093747 6934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:51.094285 6919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:51.094547 6919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:51.095685 6919 hybrid_clock.cc:648] HybridClock initialized: now 1786516071095669 us; error 28 us; skew 500 ppm
Aug 12 06:27:51 dist-test-slave-gjrz krb5kdc[6897](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516071, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:51.101824 6919 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:27:51.102241 6919 webserver.cc:460] Webserver started at http://127.0.0.1:41077/ using document root <none> and password file <none>
I20260812 06:27:51.102429 6919 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:51.102476 6919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:51.102597 6919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:51.103623 6919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "73880b7d88754dd0884b573575785894"
format_stamp: "Formatted at 2026-08-12 06:27:51 on dist-test-slave-gjrz"
server_key: "b4f8d5ffed87e666f2a862793787f5bb"
server_key_iv: "a2e1873ec762c5b0f5a5473abb1cfa8b"
server_key_version: "encryptionkey@0"
I20260812 06:27:51.103946 6919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "73880b7d88754dd0884b573575785894"
format_stamp: "Formatted at 2026-08-12 06:27:51 on dist-test-slave-gjrz"
server_key: "b4f8d5ffed87e666f2a862793787f5bb"
server_key_iv: "a2e1873ec762c5b0f5a5473abb1cfa8b"
server_key_version: "encryptionkey@0"
I20260812 06:27:51.105607 6919 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:27:51.106293 6950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:51.106433 6919 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:51.106514 6919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "73880b7d88754dd0884b573575785894"
format_stamp: "Formatted at 2026-08-12 06:27:51 on dist-test-slave-gjrz"
server_key: "b4f8d5ffed87e666f2a862793787f5bb"
server_key_iv: "a2e1873ec762c5b0f5a5473abb1cfa8b"
server_key_version: "encryptionkey@0"
I20260812 06:27:51.106578 6919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:51.109746 6919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:51.111439 6919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:51.111565 6919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:51.115337 6919 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43677
I20260812 06:27:51.115374 7063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43677 every 8 connection(s)
I20260812 06:27:51.115669 6919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:51.116470 7065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:51.118670 7065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894: Bootstrap starting.
I20260812 06:27:51.119203 7065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:51.119520 7065 log.cc:824] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:51.119657 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 6919
I20260812 06:27:51.119766 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:51.119961 30781 external_mini_cluster.cc:1428] Setting key 9ed2ffd5c7adcc4cd88248531daddf91
I20260812 06:27:51.120278 7065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894: No bootstrap required, opened a new log
I20260812 06:27:51.122395 7065 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73880b7d88754dd0884b573575785894" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43677 } }
I20260812 06:27:51.122551 7065 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:51.122586 7065 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73880b7d88754dd0884b573575785894, State: Initialized, Role: FOLLOWER
I20260812 06:27:51.122701 7065 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73880b7d88754dd0884b573575785894" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43677 } }
I20260812 06:27:51.122763 7071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:51.120442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:58597 (local address 127.0.0.1:43677)
0812 06:27:51.120597 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:51.120604 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:51.120629 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:27:51.121466 (+ 837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:51.121472 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:51.121497 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:51.121607 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:51.122206 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:51.122209 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:51.122210 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:51.122213 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:51.122252 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:51.122262 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:51.122314 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:51.122385 (+ 71us) server_negotiation.cc:299] Negotiation successful
0812 06:27:51.122418 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
I20260812 06:27:51.122771 7065 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:51.122834 7065 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:51.122874 7065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:51.123548 7065 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73880b7d88754dd0884b573575785894" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43677 } }
I20260812 06:27:51.123653 7065 leader_election.cc:302] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73880b7d88754dd0884b573575785894; no voters:
I20260812 06:27:51.123740 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:51.123811 7065 leader_election.cc:288] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:51.123834 7073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:51.123943 7073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [term 1 LEADER]: Becoming Leader. State: Replica: 73880b7d88754dd0884b573575785894, State: Running, Role: LEADER
I20260812 06:27:51.124046 7073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73880b7d88754dd0884b573575785894" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43677 } }
I20260812 06:27:51.124056 7065 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:51.124429 7074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73880b7d88754dd0884b573575785894" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73880b7d88754dd0884b573575785894" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43677 } } }
I20260812 06:27:51.124440 7075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73880b7d88754dd0884b573575785894. Latest consensus state: current_term: 1 leader_uuid: "73880b7d88754dd0884b573575785894" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73880b7d88754dd0884b573575785894" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43677 } } }
I20260812 06:27:51.124537 7074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:51.124564 7075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:51.124814 7081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:51.125306 7081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:51.127417 7081 catalog_manager.cc:1347] Generated new cluster ID: 132f1341e61443c5a0597345f1b9fc93
I20260812 06:27:51.127485 7081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:51.127588 7071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:51.125857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:33265 (local address 127.0.0.1:43677)
0812 06:27:51.125886 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:51.125887 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:51.126421 (+ 534us) server_negotiation.cc:407] Connection header received
0812 06:27:51.126534 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:51.126535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:51.126541 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:51.126591 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:51.127166 (+ 575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:51.127167 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:51.127168 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:51.127172 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:51.127185 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:51.127189 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:51.127246 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:51.127363 (+ 117us) server_negotiation.cc:299] Negotiation successful
0812 06:27:51.127377 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 06:27:51.153695 7081 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:51.153853 7081 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:51.159312 7081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73880b7d88754dd0884b573575785894: Generated new TSK 0
I20260812 06:27:51.159469 7081 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:51.163475 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 6919
2026-08-12T06:27:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1464 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:51 dist-test-slave-gjrz krb5kdc[7124](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:51 dist-test-slave-gjrz krb5kdc[7124](info): set up 2 sockets
Aug 12 06:27:51 dist-test-slave-gjrz krb5kdc[7124](info): commencing operation
krb5kdc: starting...
W20260812 06:27:52.366622 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:52 dist-test-slave-gjrz krb5kdc[7124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:27:52.473984 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42611
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:52.552425 7145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:52.552614 7145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:52.552646 7145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:52.553732 7145 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:52.553771 7145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:52.553789 7145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:52.553804 7145 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:52.553819 7145 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:52.555341 7145 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42611
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:52.555532 7145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:52.555691 7145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:52.560225 7161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:52.560232 7160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:52.560232 7168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:52.560465 7145 server_base.cc:1034] running on GCE node
I20260812 06:27:52.560680 7145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:52.560925 7145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:52.562063 7145 hybrid_clock.cc:648] HybridClock initialized: now 1786516072562049 us; error 29 us; skew 500 ppm
Aug 12 06:27:52 dist-test-slave-gjrz krb5kdc[7124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516072, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:52.564361 7145 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:27:52.564739 7145 webserver.cc:460] Webserver started at http://127.0.0.1:36435/ using document root <none> and password file <none>
I20260812 06:27:52.564916 7145 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:52.564973 7145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:52.565092 7145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:52.566030 7145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "8ca7e67f00a340559fac7635fe2ecd2f"
format_stamp: "Formatted at 2026-08-12 06:27:52 on dist-test-slave-gjrz"
server_key: "e4cc4f314200e39b1d3021ac10d98981"
server_key_iv: "c8ef016c9ee39412287c418eaf88ed54"
server_key_version: "encryptionkey@0"
I20260812 06:27:52.566336 7145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "8ca7e67f00a340559fac7635fe2ecd2f"
format_stamp: "Formatted at 2026-08-12 06:27:52 on dist-test-slave-gjrz"
server_key: "e4cc4f314200e39b1d3021ac10d98981"
server_key_iv: "c8ef016c9ee39412287c418eaf88ed54"
server_key_version: "encryptionkey@0"
I20260812 06:27:52.567570 7145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:27:52.568233 7178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:52.568374 7145 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:27:52.568449 7145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "8ca7e67f00a340559fac7635fe2ecd2f"
format_stamp: "Formatted at 2026-08-12 06:27:52 on dist-test-slave-gjrz"
server_key: "e4cc4f314200e39b1d3021ac10d98981"
server_key_iv: "c8ef016c9ee39412287c418eaf88ed54"
server_key_version: "encryptionkey@0"
I20260812 06:27:52.568513 7145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:52.582037 7145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:52.583958 7145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:52.584076 7145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:52.587873 7145 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42611
I20260812 06:27:52.587917 7275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42611 every 8 connection(s)
I20260812 06:27:52.588201 7145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:52.589000 7276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:52.591223 7276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f: Bootstrap starting.
I20260812 06:27:52.591809 7276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:52.592077 7276 log.cc:824] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:52.592685 7276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f: No bootstrap required, opened a new log
I20260812 06:27:52.594210 7276 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ca7e67f00a340559fac7635fe2ecd2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42611 } }
I20260812 06:27:52.594339 7276 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:52.594360 7276 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ca7e67f00a340559fac7635fe2ecd2f, State: Initialized, Role: FOLLOWER
I20260812 06:27:52.594499 7276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ca7e67f00a340559fac7635fe2ecd2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42611 } }
I20260812 06:27:52.594560 7276 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:52.594581 7276 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:52.594625 7276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:52.595118 7276 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ca7e67f00a340559fac7635fe2ecd2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42611 } }
I20260812 06:27:52.595213 7276 leader_election.cc:302] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ca7e67f00a340559fac7635fe2ecd2f; no voters:
I20260812 06:27:52.595391 7276 leader_election.cc:288] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:52.595423 7279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:52.595566 7279 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [term 1 LEADER]: Becoming Leader. State: Replica: 8ca7e67f00a340559fac7635fe2ecd2f, State: Running, Role: LEADER
I20260812 06:27:52.595633 7276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:52.595652 7279 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ca7e67f00a340559fac7635fe2ecd2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42611 } }
I20260812 06:27:52.596022 7283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ca7e67f00a340559fac7635fe2ecd2f. Latest consensus state: current_term: 1 leader_uuid: "8ca7e67f00a340559fac7635fe2ecd2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ca7e67f00a340559fac7635fe2ecd2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42611 } } }
I20260812 06:27:52.596141 7283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:52.596122 7280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ca7e67f00a340559fac7635fe2ecd2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ca7e67f00a340559fac7635fe2ecd2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42611 } } }
I20260812 06:27:52.596247 7280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:52.596428 7291 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:52.597030 7291 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:52.598002 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 7145
I20260812 06:27:52.598124 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:52.598299 30781 external_mini_cluster.cc:1428] Setting key cee6651b682ac9b1371a0b863af3a3ab
I20260812 06:27:52.598523 7291 catalog_manager.cc:1347] Generated new cluster ID: 93d2abb9db6d4c1eaad56ad8b4e42f81
I20260812 06:27:52.598562 7291 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:52.603473 7291 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:52.603922 7291 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:52.607398 7291 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ca7e67f00a340559fac7635fe2ecd2f: Generated new TSK 0
I20260812 06:27:52.607553 7291 catalog_manager.cc:1514] Initializing in-progress tserver states...
Aug 12 06:27:52 dist-test-slave-gjrz krb5kdc[7124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516072, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 06:27:52.611739 7318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:52.598803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:45243 (local address 127.0.0.1:42611)
0812 06:27:52.599008 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:52.599017 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:52.599045 (+ 28us) server_negotiation.cc:407] Connection header received
0812 06:27:52.599166 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:52.599172 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:52.599231 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:52.599370 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:52.600101 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:52.601435 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:52.602508 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:52.603100 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:52.603195 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:52.608985 (+ 5790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:52.608988 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:52.608989 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:52.609000 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:52.610396 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:52.610748 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:52.610750 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:52.610751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:52.610828 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:52.611027 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:52.611028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:52.611028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:52.611219 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:52.611375 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:52.611498 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 06:27:52.611591 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":57,"threads_started":1}
I20260812 06:27:52.612572 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:52.619979 7318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:52.613813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:53753 (local address 127.0.0.1:42611)
0812 06:27:52.613846 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:52.613848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:52.613904 (+ 56us) server_negotiation.cc:407] Connection header received
0812 06:27:52.613964 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:52.613965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:52.613972 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:52.614013 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:52.614607 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:52.615358 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:52.616355 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:52.616567 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:52.616610 (+ 43us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:52.617791 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:52.617792 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:52.617792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:52.617797 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:52.618935 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:52.619348 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:52.619349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:52.619349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:52.619395 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:52.619595 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:52.619596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:52.619596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:52.619678 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:52.619753 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:52.619876 (+ 123us) server_negotiation.cc:299] Negotiation successful
0812 06:27:52.619919 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:27:52.621691 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 7145
W20260812 06:27:52.635785 7121 connection.cc:535] client connection to 127.0.0.1:42611 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42611): Connection reset by peer (error 104)
2026-08-12T06:27:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1459 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:52 dist-test-slave-gjrz krb5kdc[7337](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:52 dist-test-slave-gjrz krb5kdc[7337](info): set up 2 sockets
Aug 12 06:27:52 dist-test-slave-gjrz krb5kdc[7337](info): commencing operation
krb5kdc: starting...
W20260812 06:27:53.810690 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:53 dist-test-slave-gjrz krb5kdc[7337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:27:53.919242 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33221
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:53.998407 7359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:53.998594 7359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:53.998616 7359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:53.999706 7359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:53.999742 7359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:53.999754 7359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:53.999765 7359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:53.999781 7359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:54.001191 7359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33221
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:54.001368 7359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:54.001533 7359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:54.006052 7372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:54.006110 7359 server_base.cc:1034] running on GCE node
W20260812 06:27:54.006151 7373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:54.006060 7381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:54.006490 7359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:54.006772 7359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:54.007910 7359 hybrid_clock.cc:648] HybridClock initialized: now 1786516074007897 us; error 26 us; skew 500 ppm
Aug 12 06:27:54 dist-test-slave-gjrz krb5kdc[7337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516074, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:54.010219 7359 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:27:54.010617 7359 webserver.cc:460] Webserver started at http://127.0.0.1:39685/ using document root <none> and password file <none>
I20260812 06:27:54.010799 7359 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:54.010844 7359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:54.010964 7359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:54.011941 7359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "f55703230cce47a9b9c0c14ab5df95c1"
format_stamp: "Formatted at 2026-08-12 06:27:54 on dist-test-slave-gjrz"
server_key: "03536903fccc97f5afaf7ab68eedbe59"
server_key_iv: "60e5ae8d59043bae63e4406edf6206a1"
server_key_version: "encryptionkey@0"
I20260812 06:27:54.012257 7359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "f55703230cce47a9b9c0c14ab5df95c1"
format_stamp: "Formatted at 2026-08-12 06:27:54 on dist-test-slave-gjrz"
server_key: "03536903fccc97f5afaf7ab68eedbe59"
server_key_iv: "60e5ae8d59043bae63e4406edf6206a1"
server_key_version: "encryptionkey@0"
I20260812 06:27:54.013423 7359 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:27:54.014063 7391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:54.014211 7359 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:27:54.014292 7359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "f55703230cce47a9b9c0c14ab5df95c1"
format_stamp: "Formatted at 2026-08-12 06:27:54 on dist-test-slave-gjrz"
server_key: "03536903fccc97f5afaf7ab68eedbe59"
server_key_iv: "60e5ae8d59043bae63e4406edf6206a1"
server_key_version: "encryptionkey@0"
I20260812 06:27:54.014348 7359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:54.023344 7359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:54.025209 7359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:54.025332 7359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:54.029042 7359 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33221
I20260812 06:27:54.029073 7494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33221 every 8 connection(s)
I20260812 06:27:54.029356 7359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:54.030166 7495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:54.032315 7495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1: Bootstrap starting.
I20260812 06:27:54.032863 7495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:54.033142 7495 log.cc:824] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:54.033231 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 7359
I20260812 06:27:54.033340 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:54.033517 30781 external_mini_cluster.cc:1428] Setting key 29794329d6e6bddf8585509ca4c79473
I20260812 06:27:54.033870 7495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1: No bootstrap required, opened a new log
I20260812 06:27:54.036252 7495 raft_consensus.cc:348] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f55703230cce47a9b9c0c14ab5df95c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33221 } }
I20260812 06:27:54.036392 7495 raft_consensus.cc:374] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:54.036437 7495 raft_consensus.cc:729] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f55703230cce47a9b9c0c14ab5df95c1, State: Initialized, Role: FOLLOWER
I20260812 06:27:54.036554 7495 consensus_queue.cc:260] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f55703230cce47a9b9c0c14ab5df95c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33221 } }
I20260812 06:27:54.036629 7495 raft_consensus.cc:388] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:54.036664 7495 raft_consensus.cc:482] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:54.036706 7495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:54.037354 7495 raft_consensus.cc:504] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f55703230cce47a9b9c0c14ab5df95c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33221 } }
I20260812 06:27:54.037456 7495 leader_election.cc:302] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f55703230cce47a9b9c0c14ab5df95c1; no voters:
I20260812 06:27:54.037601 7495 leader_election.cc:288] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:54.037635 7505 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:54.037784 7505 raft_consensus.cc:686] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [term 1 LEADER]: Becoming Leader. State: Replica: f55703230cce47a9b9c0c14ab5df95c1, State: Running, Role: LEADER
I20260812 06:27:54.037850 7495 sys_catalog.cc:564] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:54.037865 7505 consensus_queue.cc:237] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f55703230cce47a9b9c0c14ab5df95c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33221 } }
I20260812 06:27:54.038605 7508 sys_catalog.cc:455] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f55703230cce47a9b9c0c14ab5df95c1. Latest consensus state: current_term: 1 leader_uuid: "f55703230cce47a9b9c0c14ab5df95c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f55703230cce47a9b9c0c14ab5df95c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33221 } } }
I20260812 06:27:54.038697 7508 sys_catalog.cc:458] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:54.039016 7506 sys_catalog.cc:455] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f55703230cce47a9b9c0c14ab5df95c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f55703230cce47a9b9c0c14ab5df95c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33221 } } }
I20260812 06:27:54.039063 7523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:54.039155 7506 sys_catalog.cc:458] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:54.039604 7503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:54.033954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:55215 (local address 127.0.0.1:33221)
0812 06:27:54.034130 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:54.034138 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:54.034163 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:27:54.035036 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:54.035044 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:54.035090 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:54.035193 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:54.035444 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:54.036277 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:54.037365 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:54.037947 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:54.038045 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:54.038704 (+ 659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:54.038708 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:54.038708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:54.038907 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:54.038946 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:54.038962 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:54.039311 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:54.039359 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 06:27:54.039390 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":69,"threads_started":1}
I20260812 06:27:54.039601 7523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:54.040493 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:54.041101 7523 catalog_manager.cc:1347] Generated new cluster ID: 1184122c6eed40d3849ed259e89c6d4e
I20260812 06:27:54.041152 7523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:54.045761 7503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:54.041856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:48133 (local address 127.0.0.1:33221)
0812 06:27:54.041900 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:54.041902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:54.043404 (+ 1502us) server_negotiation.cc:407] Connection header received
0812 06:27:54.043462 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:54.043463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:54.043473 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:54.043532 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:54.043648 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:54.044083 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:54.044743 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:54.044942 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:54.044995 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:54.045535 (+ 540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:54.045537 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:54.045537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:54.045541 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:54.045554 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:54.045557 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:54.045606 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:54.045687 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 06:27:54.045696 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:27:54.051955 7523 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:54.052418 7523 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:54.056020 7523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f55703230cce47a9b9c0c14ab5df95c1: Generated new TSK 0
I20260812 06:27:54.056169 7523 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:54.057876 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 7359
W20260812 06:27:54.079247 7334 connection.cc:535] client connection to 127.0.0.1:33221 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33221): Connection reset by peer (error 104)
2026-08-12T06:27:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1443 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:54 dist-test-slave-gjrz krb5kdc[7575](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:54 dist-test-slave-gjrz krb5kdc[7575](info): set up 2 sockets
Aug 12 06:27:54 dist-test-slave-gjrz krb5kdc[7575](info): commencing operation
krb5kdc: starting...
W20260812 06:27:55.261039 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:55 dist-test-slave-gjrz krb5kdc[7575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516075, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 06:27:55.369676 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36059
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39335
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:55.447870 7605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:55.448062 7605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:55.448083 7605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:55.449334 7605 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:55.449389 7605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:55.449404 7605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:55.449435 7605 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:55.449458 7605 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:55.450949 7605 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39335
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36059
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:55.451171 7605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:55.451388 7605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:55.455859 7610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:55.455907 7613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:55.455927 7611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:55.456019 7605 server_base.cc:1034] running on GCE node
I20260812 06:27:55.456285 7605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:55.456564 7605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:55.457695 7605 hybrid_clock.cc:648] HybridClock initialized: now 1786516075457686 us; error 26 us; skew 500 ppm
Aug 12 06:27:55 dist-test-slave-gjrz krb5kdc[7575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516075, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:55.460058 7605 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 06:27:55.460404 7605 webserver.cc:460] Webserver started at http://127.0.0.1:40045/ using document root <none> and password file <none>
I20260812 06:27:55.460579 7605 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:55.460616 7605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:55.460702 7605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:55.461621 7605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "645c0510e312427a8c56c4c15d9672d8"
format_stamp: "Formatted at 2026-08-12 06:27:55 on dist-test-slave-gjrz"
server_key: "3060aa274ec93da40e9cb11ec0f502b9"
server_key_iv: "36e148aa031365160d340f07b80debc5"
server_key_version: "encryptionkey@0"
I20260812 06:27:55.461913 7605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "645c0510e312427a8c56c4c15d9672d8"
format_stamp: "Formatted at 2026-08-12 06:27:55 on dist-test-slave-gjrz"
server_key: "3060aa274ec93da40e9cb11ec0f502b9"
server_key_iv: "36e148aa031365160d340f07b80debc5"
server_key_version: "encryptionkey@0"
I20260812 06:27:55.463102 7605 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:27:55.463901 7632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:55.464051 7605 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:55.464143 7605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "645c0510e312427a8c56c4c15d9672d8"
format_stamp: "Formatted at 2026-08-12 06:27:55 on dist-test-slave-gjrz"
server_key: "3060aa274ec93da40e9cb11ec0f502b9"
server_key_iv: "36e148aa031365160d340f07b80debc5"
server_key_version: "encryptionkey@0"
I20260812 06:27:55.464200 7605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:55.467316 7605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:55.468956 7605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:55.469058 7605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:55.472719 7605 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36059
I20260812 06:27:55.472749 7745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36059 every 8 connection(s)
I20260812 06:27:55.473033 7605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:55.473582 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 7605
I20260812 06:27:55.473680 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:55.473837 30781 external_mini_cluster.cc:1428] Setting key 1a4a800d64e3178e24b69b34eadf2893
I20260812 06:27:55.473865 7746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:55.476421 7750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:55.474309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:49215 (local address 127.0.0.1:36059)
0812 06:27:55.474594 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:55.474603 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:55.474635 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:27:55.475303 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:55.475312 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:55.475346 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:55.475487 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:55.476020 (+ 533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:55.476024 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:55.476024 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:55.476029 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:55.476081 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:55.476094 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:55.476160 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:55.476210 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 06:27:55.476249 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":67,"threads_started":1}
I20260812 06:27:55.477032 7746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8: Bootstrap starting.
I20260812 06:27:55.477393 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:55.477675 7746 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:55.477919 7746 log.cc:824] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:55.478564 7746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8: No bootstrap required, opened a new log
I20260812 06:27:55.480424 7750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:55.479585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.164:39371 (local address 127.0.0.1:36059)
0812 06:27:55.479629 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:55.479631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:55.479676 (+ 45us) server_negotiation.cc:407] Connection header received
0812 06:27:55.479739 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:55.479740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:55.479744 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:55.479796 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:55.480235 (+ 439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:55.480236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:55.480236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:55.480240 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:55.480254 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:55.480257 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:55.480320 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:55.480360 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 06:27:55.480370 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260812 06:27:55.480625 7746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645c0510e312427a8c56c4c15d9672d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36059 } }
I20260812 06:27:55.480760 7746 raft_consensus.cc:374] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:55.480792 7746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645c0510e312427a8c56c4c15d9672d8, State: Initialized, Role: FOLLOWER
I20260812 06:27:55.480906 7746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645c0510e312427a8c56c4c15d9672d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36059 } }
I20260812 06:27:55.480996 7746 raft_consensus.cc:388] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:55.481034 7746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:55.481081 7746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:55.481570 7746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645c0510e312427a8c56c4c15d9672d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36059 } }
I20260812 06:27:55.481657 7746 leader_election.cc:302] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 645c0510e312427a8c56c4c15d9672d8; no voters:
I20260812 06:27:55.481804 7746 leader_election.cc:288] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:55.481848 7765 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:55.482019 7765 raft_consensus.cc:686] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [term 1 LEADER]: Becoming Leader. State: Replica: 645c0510e312427a8c56c4c15d9672d8, State: Running, Role: LEADER
I20260812 06:27:55.482018 7746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:55.482127 7765 consensus_queue.cc:237] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645c0510e312427a8c56c4c15d9672d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36059 } }
I20260812 06:27:55.482442 7769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 645c0510e312427a8c56c4c15d9672d8. Latest consensus state: current_term: 1 leader_uuid: "645c0510e312427a8c56c4c15d9672d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645c0510e312427a8c56c4c15d9672d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36059 } } }
I20260812 06:27:55.482467 7768 sys_catalog.cc:455] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "645c0510e312427a8c56c4c15d9672d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645c0510e312427a8c56c4c15d9672d8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36059 } } }
I20260812 06:27:55.482579 7769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:55.482652 7768 sys_catalog.cc:458] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8 [sys.catalog]: This master's current role is: LEADER
W20260812 06:27:55.483711 7798 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:27:55.483755 7798 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:27:55.483814 7785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:55.483987 7785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:55.485311 7785 catalog_manager.cc:1347] Generated new cluster ID: b49b4cdd678e4316ad8aa1e726a4298e
I20260812 06:27:55.485359 7785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:55.492199 7785 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:55.492375 7785 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:55.506199 7785 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 645c0510e312427a8c56c4c15d9672d8: Generated new TSK 0
I20260812 06:27:55.506351 7785 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:55.508461 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 7605
2026-08-12T06:27:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1450 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:55 dist-test-slave-gjrz krb5kdc[7807](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:55 dist-test-slave-gjrz krb5kdc[7807](info): set up 2 sockets
Aug 12 06:27:55 dist-test-slave-gjrz krb5kdc[7807](info): commencing operation
krb5kdc: starting...
W20260812 06:27:56.710335 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:56 dist-test-slave-gjrz krb5kdc[7807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:27:56.819877 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:39385
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:44719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:39385
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:56.897081 7830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:56.897275 7830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:56.897306 7830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:56.898377 7830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:56.898416 7830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:56.898434 7830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:56.898450 7830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:56.898468 7830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:56.899907 7830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:44719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:39385
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:39385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:56.900147 7830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:56.900337 7830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:56.904801 7839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:56.904865 7830 server_base.cc:1034] running on GCE node
W20260812 06:27:56.904814 7848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:56.904814 7837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:56.905191 7830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:56.905453 7830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:56.906584 7830 hybrid_clock.cc:648] HybridClock initialized: now 1786516076906578 us; error 32 us; skew 500 ppm
Aug 12 06:27:56 dist-test-slave-gjrz krb5kdc[7807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516076, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:56.911650 7830 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:27:56.912046 7830 webserver.cc:460] Webserver started at http://127.30.15.126:45127/ using document root <none> and password file <none>
I20260812 06:27:56.912252 7830 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:56.912297 7830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:56.912396 7830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:56.913337 7830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "d79aab0d2cf247189ab1e0f33794d227"
format_stamp: "Formatted at 2026-08-12 06:27:56 on dist-test-slave-gjrz"
server_key: "51a7626fa5ec0f1627c141c7908fef67"
server_key_iv: "560f59d01550bdd654f0981061eca610"
server_key_version: "encryptionkey@0"
I20260812 06:27:56.913641 7830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "d79aab0d2cf247189ab1e0f33794d227"
format_stamp: "Formatted at 2026-08-12 06:27:56 on dist-test-slave-gjrz"
server_key: "51a7626fa5ec0f1627c141c7908fef67"
server_key_iv: "560f59d01550bdd654f0981061eca610"
server_key_version: "encryptionkey@0"
I20260812 06:27:56.914899 7830 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:27:56.915576 7860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:56.915711 7830 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:56.915786 7830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "d79aab0d2cf247189ab1e0f33794d227"
format_stamp: "Formatted at 2026-08-12 06:27:56 on dist-test-slave-gjrz"
server_key: "51a7626fa5ec0f1627c141c7908fef67"
server_key_iv: "560f59d01550bdd654f0981061eca610"
server_key_version: "encryptionkey@0"
I20260812 06:27:56.915854 7830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:56.929344 7830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:56.930909 7830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:56.931010 7830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:56.934741 7830 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:39385
I20260812 06:27:56.934774 7954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:39385 every 8 connection(s)
I20260812 06:27:56.935052 7830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:56.935856 7955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:56.937953 7955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227: Bootstrap starting.
I20260812 06:27:56.938503 7955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:56.938752 7955 log.cc:824] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:56.939378 7955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227: No bootstrap required, opened a new log
I20260812 06:27:56.940902 7955 raft_consensus.cc:348] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d79aab0d2cf247189ab1e0f33794d227" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39385 } }
I20260812 06:27:56.941051 7955 raft_consensus.cc:374] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:56.941085 7955 raft_consensus.cc:729] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d79aab0d2cf247189ab1e0f33794d227, State: Initialized, Role: FOLLOWER
I20260812 06:27:56.941219 7955 consensus_queue.cc:260] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d79aab0d2cf247189ab1e0f33794d227" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39385 } }
I20260812 06:27:56.941279 7955 raft_consensus.cc:388] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:56.941299 7955 raft_consensus.cc:482] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:56.941344 7955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:56.942140 7955 raft_consensus.cc:504] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d79aab0d2cf247189ab1e0f33794d227" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39385 } }
I20260812 06:27:56.942230 7955 leader_election.cc:302] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d79aab0d2cf247189ab1e0f33794d227; no voters:
I20260812 06:27:56.942374 7955 leader_election.cc:288] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:56.942411 7965 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:56.942546 7965 raft_consensus.cc:686] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [term 1 LEADER]: Becoming Leader. State: Replica: d79aab0d2cf247189ab1e0f33794d227, State: Running, Role: LEADER
I20260812 06:27:56.942600 7955 sys_catalog.cc:564] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:56.942723 7965 consensus_queue.cc:237] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d79aab0d2cf247189ab1e0f33794d227" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39385 } }
I20260812 06:27:56.943075 7966 sys_catalog.cc:455] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d79aab0d2cf247189ab1e0f33794d227" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d79aab0d2cf247189ab1e0f33794d227" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39385 } } }
I20260812 06:27:56.943085 7967 sys_catalog.cc:455] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d79aab0d2cf247189ab1e0f33794d227. Latest consensus state: current_term: 1 leader_uuid: "d79aab0d2cf247189ab1e0f33794d227" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d79aab0d2cf247189ab1e0f33794d227" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 39385 } } }
I20260812 06:27:56.943216 7966 sys_catalog.cc:458] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:56.943238 7967 sys_catalog.cc:458] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:56.943753 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 7830
I20260812 06:27:56.943871 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:56.944077 30781 external_mini_cluster.cc:1428] Setting key 7b8d48458fc6253c0deb6bedbaa5c54d
W20260812 06:27:56.944347 7991 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:27:56.944391 7991 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:27:56.944432 7982 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:56.944573 7982 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:56.946043 7982 catalog_manager.cc:1347] Generated new cluster ID: 066c97a6779a4aaab30688de643fd8f0
I20260812 06:27:56.946101 7982 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:27:56 dist-test-slave-gjrz krb5kdc[7807](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:27:56.955179 7997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:56.944736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58527 (local address 127.30.15.126:39385)
0812 06:27:56.944882 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:56.944892 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:56.944922 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:27:56.945069 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:56.945076 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:56.945130 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:56.945259 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:56.945959 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:56.947350 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:56.948386 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:56.948989 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:56.949354 (+ 365us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:56.951621 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:56.951625 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:56.951626 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:56.951637 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:56.953390 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:56.953808 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:56.953811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:56.953811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:56.953902 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:56.954098 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:56.954099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:56.954099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:56.954360 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:56.954797 (+ 437us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:56.954874 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 06:27:56.954964 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260812 06:27:56.956010 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:56.957664 7982 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:56.958117 7982 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:56.966455 7982 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d79aab0d2cf247189ab1e0f33794d227: Generated new TSK 0
I20260812 06:27:56.966643 7982 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:56.968199 7997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:56.957348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38133 (local address 127.30.15.126:39385)
0812 06:27:56.957376 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:56.957378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:56.957503 (+ 125us) server_negotiation.cc:407] Connection header received
0812 06:27:56.957560 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:56.957561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:56.957570 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:56.957622 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:56.962302 (+ 4680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:56.963049 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:56.964050 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:56.964345 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:56.964394 (+ 49us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:56.965689 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:56.965691 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:56.965691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:27:56.965697 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:56.967149 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:56.967557 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:56.967558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:56.967558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:56.967610 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:27:56.967805 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:27:56.967806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:27:56.967806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:27:56.967893 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:56.967960 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:56.968100 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 06:27:56.968145 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12}
I20260812 06:27:56.969841 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 7830
W20260812 06:27:56.986052 7805 connection.cc:535] client connection to 127.30.15.126:39385 recv error: Network error: failed to read from TLS socket (remote: 127.30.15.126:39385): Connection reset by peer (error 104)
2026-08-12T06:27:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1455 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:57 dist-test-slave-gjrz krb5kdc[8025](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:57 dist-test-slave-gjrz krb5kdc[8025](info): set up 2 sockets
Aug 12 06:27:57 dist-test-slave-gjrz krb5kdc[8025](info): commencing operation
krb5kdc: starting...
W20260812 06:27:58.165529 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:58 dist-test-slave-gjrz krb5kdc[8025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:27:58.275604 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:36199
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:44223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:36199
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:58.353654 8044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:58.353837 8044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:58.353858 8044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:58.354908 8044 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:58.354941 8044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:58.354961 8044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:58.354972 8044 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:58.354986 8044 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:58.356381 8044 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:44223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:36199
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:36199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:58.356559 8044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:58.356730 8044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:58.361117 8059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:58.361199 8044 server_base.cc:1034] running on GCE node
W20260812 06:27:58.361128 8051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:58.361135 8054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:58.361526 8044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:58.361784 8044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:58.362932 8044 hybrid_clock.cc:648] HybridClock initialized: now 1786516078362916 us; error 39 us; skew 500 ppm
Aug 12 06:27:58 dist-test-slave-gjrz krb5kdc[8025](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516078, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:58.365379 8044 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:27:58.365782 8044 webserver.cc:460] Webserver started at http://127.30.15.126:46753/ using document root <none> and password file <none>
I20260812 06:27:58.365994 8044 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:58.366042 8044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:58.366163 8044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:58.367125 8044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "78213ce7e8ba4348a457bb42107067cc"
format_stamp: "Formatted at 2026-08-12 06:27:58 on dist-test-slave-gjrz"
server_key: "db4d731dfcb2318b6c6b77255c599af5"
server_key_iv: "b7752b3c99d5dfc8d3fb5f3fd16d3b7d"
server_key_version: "encryptionkey@0"
I20260812 06:27:58.367458 8044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "78213ce7e8ba4348a457bb42107067cc"
format_stamp: "Formatted at 2026-08-12 06:27:58 on dist-test-slave-gjrz"
server_key: "db4d731dfcb2318b6c6b77255c599af5"
server_key_iv: "b7752b3c99d5dfc8d3fb5f3fd16d3b7d"
server_key_version: "encryptionkey@0"
I20260812 06:27:58.368636 8044 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260812 06:27:58.369277 8073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:58.369437 8044 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:27:58.369509 8044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "78213ce7e8ba4348a457bb42107067cc"
format_stamp: "Formatted at 2026-08-12 06:27:58 on dist-test-slave-gjrz"
server_key: "db4d731dfcb2318b6c6b77255c599af5"
server_key_iv: "b7752b3c99d5dfc8d3fb5f3fd16d3b7d"
server_key_version: "encryptionkey@0"
I20260812 06:27:58.369570 8044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:58.380110 8044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:58.381990 8044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:58.382115 8044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:58.385790 8044 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:36199
I20260812 06:27:58.385826 8190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:36199 every 8 connection(s)
I20260812 06:27:58.386121 8044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:58.386880 8193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:58.388980 8193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc: Bootstrap starting.
I20260812 06:27:58.389539 8193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:58.389658 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 8044
I20260812 06:27:58.389768 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:58.389791 8193 log.cc:824] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:58.389961 30781 external_mini_cluster.cc:1428] Setting key f1675937d6981ba146415d0f7673b0df
I20260812 06:27:58.390518 8193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc: No bootstrap required, opened a new log
I20260812 06:27:58.392686 8193 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78213ce7e8ba4348a457bb42107067cc" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 36199 } }
I20260812 06:27:58.392809 8193 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:58.392843 8193 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78213ce7e8ba4348a457bb42107067cc, State: Initialized, Role: FOLLOWER
I20260812 06:27:58.392970 8193 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78213ce7e8ba4348a457bb42107067cc" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 36199 } }
I20260812 06:27:58.393041 8193 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:58.393072 8193 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:58.393119 8193 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:58.393607 8193 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78213ce7e8ba4348a457bb42107067cc" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 36199 } }
I20260812 06:27:58.393700 8193 leader_election.cc:302] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78213ce7e8ba4348a457bb42107067cc; no voters:
I20260812 06:27:58.393853 8193 leader_election.cc:288] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:58.393893 8202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:58.394032 8202 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [term 1 LEADER]: Becoming Leader. State: Replica: 78213ce7e8ba4348a457bb42107067cc, State: Running, Role: LEADER
I20260812 06:27:58.394148 8193 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:58.394160 8202 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78213ce7e8ba4348a457bb42107067cc" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 36199 } }
I20260812 06:27:58.394877 8203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78213ce7e8ba4348a457bb42107067cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78213ce7e8ba4348a457bb42107067cc" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 36199 } } }
I20260812 06:27:58.394982 8203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:58.395015 8201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:58.390415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57927 (local address 127.30.15.126:36199)
0812 06:27:58.390593 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:58.390602 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:58.390631 (+ 29us) server_negotiation.cc:407] Connection header received
0812 06:27:58.391004 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:58.391010 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:58.391052 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:58.391163 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:58.391399 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:58.392308 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:58.393129 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:58.393566 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:58.393660 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:58.394297 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:58.394300 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:58.394300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:58.394493 (+ 193us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:58.394521 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:58.394532 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:58.394609 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:58.394754 (+ 145us) server_negotiation.cc:299] Negotiation successful
0812 06:27:58.394786 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":83,"threads_started":1}
I20260812 06:27:58.395401 8205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78213ce7e8ba4348a457bb42107067cc. Latest consensus state: current_term: 1 leader_uuid: "78213ce7e8ba4348a457bb42107067cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78213ce7e8ba4348a457bb42107067cc" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 36199 } } }
I20260812 06:27:58.395779 8205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:58.396027 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260812 06:27:58.396052 8233 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:27:58.396135 8233 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:27:58.397073 8215 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:58.397256 8215 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:58.399608 8215 catalog_manager.cc:1347] Generated new cluster ID: 6fab74138a3249ecb4f9ee5c55d6488e
I20260812 06:27:58.399654 8215 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:58.400362 8201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:58.397240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55035 (local address 127.30.15.126:36199)
0812 06:27:58.397275 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:58.397277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:58.397497 (+ 220us) server_negotiation.cc:407] Connection header received
0812 06:27:58.397542 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:58.397543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:58.397553 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:58.397613 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:58.397746 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:58.398428 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:58.399098 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:27:58.399455 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:27:58.399522 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:27:58.400139 (+ 617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:58.400140 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:58.400141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:58.400145 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:58.400158 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:58.400162 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:58.400213 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:58.400289 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 06:27:58.400297 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:27:58.404767 8215 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:58.405313 8215 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:58.409842 8215 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78213ce7e8ba4348a457bb42107067cc: Generated new TSK 0
I20260812 06:27:58.409991 8215 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:58.416734 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 8044
W20260812 06:27:58.432440 8020 connection.cc:535] client connection to 127.30.15.126:36199 recv error: Network error: failed to read from TLS socket (remote: 127.30.15.126:36199): Connection reset by peer (error 104)
2026-08-12T06:27:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1446 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:58 dist-test-slave-gjrz krb5kdc[8259](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:58 dist-test-slave-gjrz krb5kdc[8259](info): set up 2 sockets
Aug 12 06:27:58 dist-test-slave-gjrz krb5kdc[8259](info): commencing operation
krb5kdc: starting...
W20260812 06:27:59.618227 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:27:59 dist-test-slave-gjrz krb5kdc[8259](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:27:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:27:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:27:59.727435 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:43555
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:39007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:43555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:27:59.809175 8287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:27:59.809357 8287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:27:59.809378 8287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:27:59.810415 8287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:27:59.810448 8287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:27:59.810461 8287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:27:59.810487 8287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:27:59.810498 8287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:27:59.811910 8287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:39007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:43555
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:43555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:27:59.812083 8287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:27:59.812250 8287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:27:59.816694 8296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:27:59.816725 8297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:59.816745 8287 server_base.cc:1034] running on GCE node
W20260812 06:27:59.816723 8300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:27:59.817072 8287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:27:59.817348 8287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:27:59.818499 8287 hybrid_clock.cc:648] HybridClock initialized: now 1786516079818481 us; error 31 us; skew 500 ppm
Aug 12 06:27:59 dist-test-slave-gjrz krb5kdc[8259](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516079, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:27:59.820832 8287 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:27:59.821259 8287 webserver.cc:460] Webserver started at http://127.30.15.126:41769/ using document root <none> and password file <none>
I20260812 06:27:59.821481 8287 fs_manager.cc:359] Metadata directory not provided
I20260812 06:27:59.821529 8287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:27:59.821652 8287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:27:59.822636 8287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "5510d6262a9b4b3ab199cebf7276d4e6"
format_stamp: "Formatted at 2026-08-12 06:27:59 on dist-test-slave-gjrz"
server_key: "5374f9de05e34975549f24360b52b849"
server_key_iv: "38b3cd5a8bf645693078ed375afce0b1"
server_key_version: "encryptionkey@0"
I20260812 06:27:59.822952 8287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "5510d6262a9b4b3ab199cebf7276d4e6"
format_stamp: "Formatted at 2026-08-12 06:27:59 on dist-test-slave-gjrz"
server_key: "5374f9de05e34975549f24360b52b849"
server_key_iv: "38b3cd5a8bf645693078ed375afce0b1"
server_key_version: "encryptionkey@0"
I20260812 06:27:59.824242 8287 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:27:59.824975 8310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:27:59.825119 8287 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:27:59.825199 8287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "5510d6262a9b4b3ab199cebf7276d4e6"
format_stamp: "Formatted at 2026-08-12 06:27:59 on dist-test-slave-gjrz"
server_key: "5374f9de05e34975549f24360b52b849"
server_key_iv: "38b3cd5a8bf645693078ed375afce0b1"
server_key_version: "encryptionkey@0"
I20260812 06:27:59.825258 8287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:27:59.828428 8287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:27:59.830014 8287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:27:59.830133 8287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:27:59.833847 8287 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:43555
I20260812 06:27:59.833876 8421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:43555 every 8 connection(s)
I20260812 06:27:59.834151 8287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:27:59.834988 8423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:27:59.837067 8423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6: Bootstrap starting.
I20260812 06:27:59.837587 8423 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6: Neither blocks nor log segments found. Creating new log.
I20260812 06:27:59.837836 8423 log.cc:824] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6: Log is configured to *not* fsync() on all Append() calls
I20260812 06:27:59.838438 8423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6: No bootstrap required, opened a new log
I20260812 06:27:59.839987 8423 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5510d6262a9b4b3ab199cebf7276d4e6" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 43555 } }
I20260812 06:27:59.840128 8423 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:27:59.840150 8423 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5510d6262a9b4b3ab199cebf7276d4e6, State: Initialized, Role: FOLLOWER
I20260812 06:27:59.840276 8423 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5510d6262a9b4b3ab199cebf7276d4e6" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 43555 } }
I20260812 06:27:59.840348 8423 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:27:59.840381 8423 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:27:59.840426 8423 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:27:59.841162 8423 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5510d6262a9b4b3ab199cebf7276d4e6" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 43555 } }
I20260812 06:27:59.841270 8423 leader_election.cc:302] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5510d6262a9b4b3ab199cebf7276d4e6; no voters:
I20260812 06:27:59.841418 8423 leader_election.cc:288] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:27:59.841408 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 8287
I20260812 06:27:59.841444 8433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:27:59.841522 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:27:59.841563 8433 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [term 1 LEADER]: Becoming Leader. State: Replica: 5510d6262a9b4b3ab199cebf7276d4e6, State: Running, Role: LEADER
I20260812 06:27:59.841634 8433 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5510d6262a9b4b3ab199cebf7276d4e6" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 43555 } }
I20260812 06:27:59.841657 8423 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:27:59.841717 30781 external_mini_cluster.cc:1428] Setting key 795ed3f42fc9635f7eb50e1c21789263
I20260812 06:27:59.841969 8435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5510d6262a9b4b3ab199cebf7276d4e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5510d6262a9b4b3ab199cebf7276d4e6" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 43555 } } }
I20260812 06:27:59.842053 8435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:59.841964 8433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5510d6262a9b4b3ab199cebf7276d4e6. Latest consensus state: current_term: 1 leader_uuid: "5510d6262a9b4b3ab199cebf7276d4e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5510d6262a9b4b3ab199cebf7276d4e6" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 43555 } } }
I20260812 06:27:59.842204 8433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6 [sys.catalog]: This master's current role is: LEADER
I20260812 06:27:59.843071 8443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:27:59.843614 8443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:27:59.845010 8443 catalog_manager.cc:1347] Generated new cluster ID: 64bcffef65ed4b34861abbc6df9bb456
I20260812 06:27:59.845054 8443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:27:59.848063 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:59.842346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47813 (local address 127.30.15.126:43555)
0812 06:27:59.842485 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:59.842494 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:59.842738 (+ 244us) server_negotiation.cc:407] Connection header received
0812 06:27:59.842875 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:59.842881 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:59.842908 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:59.843031 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:59.847659 (+ 4628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:59.847663 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:59.847663 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:59.847668 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:59.847712 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:59.847726 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:59.847799 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:59.847855 (+ 56us) server_negotiation.cc:299] Negotiation successful
0812 06:27:59.847895 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":67,"threads_started":1}
I20260812 06:27:59.848932 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:27:59.851455 8457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:27:59.850435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43277 (local address 127.30.15.126:43555)
0812 06:27:59.850470 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0812 06:27:59.850472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:27:59.850612 (+ 140us) server_negotiation.cc:407] Connection header received
0812 06:27:59.850670 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:27:59.850671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:27:59.850676 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:27:59.850724 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:27:59.851235 (+ 511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:27:59.851236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:27:59.851237 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:27:59.851241 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:27:59.851254 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:27:59.851258 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:27:59.851327 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 06:27:59.851375 (+ 48us) server_negotiation.cc:299] Negotiation successful
0812 06:27:59.851387 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:27:59.852419 8443 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:27:59.852566 8443 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:27:59.854873 8443 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5510d6262a9b4b3ab199cebf7276d4e6: Generated new TSK 0
I20260812 06:27:59.855021 8443 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:27:59.856083 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 8287
2026-08-12T06:27:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1445 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:27:59 dist-test-slave-gjrz krb5kdc[8495](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:27:59 dist-test-slave-gjrz krb5kdc[8495](info): set up 2 sockets
Aug 12 06:27:59 dist-test-slave-gjrz krb5kdc[8495](info): commencing operation
krb5kdc: starting...
W20260812 06:28:01.062163 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:28:01 dist-test-slave-gjrz krb5kdc[8495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:28:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:28:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:28:01.173718 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:46661
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:46661
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:28:01.251845 8521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:28:01.252029 8521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:28:01.252050 8521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:28:01.253103 8521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:28:01.253134 8521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:28:01.253146 8521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:28:01.253157 8521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:28:01.253167 8521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:28:01.254542 8521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:46661
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:46661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:28:01.254715 8521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:28:01.254882 8521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:28:01.259238 8541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:01.259357 8534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:01.259243 8532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:01.259346 8521 server_base.cc:1034] running on GCE node
I20260812 06:28:01.259697 8521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:28:01.259949 8521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:28:01.261094 8521 hybrid_clock.cc:648] HybridClock initialized: now 1786516081261078 us; error 28 us; skew 500 ppm
Aug 12 06:28:01 dist-test-slave-gjrz krb5kdc[8495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516081, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:28:01.263376 8521 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:28:01.263790 8521 webserver.cc:460] Webserver started at http://127.30.15.126:45593/ using document root <none> and password file <none>
I20260812 06:28:01.264006 8521 fs_manager.cc:359] Metadata directory not provided
I20260812 06:28:01.264055 8521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:28:01.264178 8521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:28:01.265120 8521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "45bb19c328994c71baa8b24cb0f8b143"
format_stamp: "Formatted at 2026-08-12 06:28:01 on dist-test-slave-gjrz"
server_key: "a914dea06d3befbe1c83bc2680bfea67"
server_key_iv: "61e75dd080c29dfc1dceab43a95cbcdd"
server_key_version: "encryptionkey@0"
I20260812 06:28:01.265429 8521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "45bb19c328994c71baa8b24cb0f8b143"
format_stamp: "Formatted at 2026-08-12 06:28:01 on dist-test-slave-gjrz"
server_key: "a914dea06d3befbe1c83bc2680bfea67"
server_key_iv: "61e75dd080c29dfc1dceab43a95cbcdd"
server_key_version: "encryptionkey@0"
I20260812 06:28:01.266597 8521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:28:01.267195 8557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:28:01.267350 8521 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:28:01.267431 8521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "45bb19c328994c71baa8b24cb0f8b143"
format_stamp: "Formatted at 2026-08-12 06:28:01 on dist-test-slave-gjrz"
server_key: "a914dea06d3befbe1c83bc2680bfea67"
server_key_iv: "61e75dd080c29dfc1dceab43a95cbcdd"
server_key_version: "encryptionkey@0"
I20260812 06:28:01.267503 8521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:28:01.286051 8521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:28:01.287736 8521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:28:01.287860 8521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:28:01.291561 8521 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:46661
I20260812 06:28:01.291595 8663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:46661 every 8 connection(s)
I20260812 06:28:01.291895 8521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:28:01.292708 8666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:28:01.294872 8666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143: Bootstrap starting.
I20260812 06:28:01.295452 8666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143: Neither blocks nor log segments found. Creating new log.
I20260812 06:28:01.295702 8666 log.cc:824] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143: Log is configured to *not* fsync() on all Append() calls
I20260812 06:28:01.296339 8666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143: No bootstrap required, opened a new log
I20260812 06:28:01.297895 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 8521
I20260812 06:28:01.298018 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:28:01.298027 8666 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45bb19c328994c71baa8b24cb0f8b143" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46661 } }
I20260812 06:28:01.298189 8666 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:28:01.298219 30781 external_mini_cluster.cc:1428] Setting key 833ef48a4711c59436a9960caa95c04d
I20260812 06:28:01.298229 8666 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45bb19c328994c71baa8b24cb0f8b143, State: Initialized, Role: FOLLOWER
I20260812 06:28:01.298368 8666 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45bb19c328994c71baa8b24cb0f8b143" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46661 } }
I20260812 06:28:01.298439 8666 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:28:01.298470 8666 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:28:01.298520 8666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:28:01.299521 8666 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45bb19c328994c71baa8b24cb0f8b143" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46661 } }
I20260812 06:28:01.299638 8666 leader_election.cc:302] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45bb19c328994c71baa8b24cb0f8b143; no voters:
I20260812 06:28:01.299798 8666 leader_election.cc:288] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:28:01.299824 8671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:28:01.299955 8671 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [term 1 LEADER]: Becoming Leader. State: Replica: 45bb19c328994c71baa8b24cb0f8b143, State: Running, Role: LEADER
I20260812 06:28:01.300100 8666 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:28:01.300078 8671 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45bb19c328994c71baa8b24cb0f8b143" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46661 } }
I20260812 06:28:01.300450 8671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45bb19c328994c71baa8b24cb0f8b143. Latest consensus state: current_term: 1 leader_uuid: "45bb19c328994c71baa8b24cb0f8b143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45bb19c328994c71baa8b24cb0f8b143" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46661 } } }
I20260812 06:28:01.300525 8671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [sys.catalog]: This master's current role is: LEADER
I20260812 06:28:01.300707 8672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45bb19c328994c71baa8b24cb0f8b143" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45bb19c328994c71baa8b24cb0f8b143" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46661 } } }
I20260812 06:28:01.300731 8679 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:28:01.300768 8672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143 [sys.catalog]: This master's current role is: LEADER
I20260812 06:28:01.301226 8679 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:28:01.303500 8679 catalog_manager.cc:1347] Generated new cluster ID: 5847c78135284f0a8fe300e0846a4eb2
I20260812 06:28:01.303555 8679 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 12 06:28:01 dist-test-slave-gjrz krb5kdc[8495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:28:01.308923 8670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:01.298663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37009 (local address 127.30.15.126:46661)
0812 06:28:01.298834 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:01.298842 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:01.298888 (+ 46us) server_negotiation.cc:407] Connection header received
0812 06:28:01.298989 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:01.298994 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:01.299032 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:01.299128 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:01.299936 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:01.301245 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:01.302217 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:01.302777 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:01.302874 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:01.305441 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:01.305445 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:01.305445 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:01.305456 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:01.307296 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:01.307657 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:01.307660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:01.307660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:01.307787 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:01.307967 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:01.307968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:01.307968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:01.308256 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:01.308423 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:01.308489 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 06:28:01.308729 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260812 06:28:01.309784 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:28:01.312933 8679 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:28:01.313372 8679 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:28:01.317828 8670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:01.311258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52517 (local address 127.30.15.126:46661)
0812 06:28:01.311310 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:01.311311 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:01.311321 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:28:01.311339 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:01.311340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:01.311360 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:01.311418 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:01.311979 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:01.312693 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:01.313678 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:01.313995 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:01.314031 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:01.315348 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:01.315350 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:01.315350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:01.315357 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:01.316665 (+ 1308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:01.317055 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:01.317056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:01.317056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:01.317105 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:01.317284 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:01.317285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:01.317285 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:01.317394 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:01.317465 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:01.317659 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 06:28:01.317742 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:28:01.318687 8679 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45bb19c328994c71baa8b24cb0f8b143: Generated new TSK 0
I20260812 06:28:01.318837 8679 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:28:01.325673 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 8521
2026-08-12T06:28:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1471 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:28:01 dist-test-slave-gjrz krb5kdc[8733](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:28:01 dist-test-slave-gjrz krb5kdc[8733](info): set up 2 sockets
Aug 12 06:28:01 dist-test-slave-gjrz krb5kdc[8733](info): commencing operation
krb5kdc: starting...
W20260812 06:28:02.535558 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:28:02 dist-test-slave-gjrz krb5kdc[8733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:28:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:28:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:28:02.645102 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:46349
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:46349
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:28:02.723873 8759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:28:02.724052 8759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:28:02.724074 8759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:28:02.725195 8759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:28:02.725235 8759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:28:02.725248 8759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:28:02.725260 8759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:28:02.725270 8759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:28:02.726665 8759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:46349
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:46349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:28:02.726869 8759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:28:02.727063 8759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:28:02.731528 8771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:02.731528 8775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:02.731643 8759 server_base.cc:1034] running on GCE node
W20260812 06:28:02.731770 8768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:02.731983 8759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:28:02.732254 8759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:28:02.733383 8759 hybrid_clock.cc:648] HybridClock initialized: now 1786516082733372 us; error 29 us; skew 500 ppm
Aug 12 06:28:02 dist-test-slave-gjrz krb5kdc[8733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516082, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:28:02.738418 8759 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:28:02.738818 8759 webserver.cc:460] Webserver started at http://127.30.15.126:42353/ using document root <none> and password file <none>
I20260812 06:28:02.738998 8759 fs_manager.cc:359] Metadata directory not provided
I20260812 06:28:02.739051 8759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:28:02.739171 8759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:28:02.740183 8759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "4fc25f6df2124e1188341709580ed98c"
format_stamp: "Formatted at 2026-08-12 06:28:02 on dist-test-slave-gjrz"
server_key: "d5b5ba1d5a9bb52d315fe7de39da3dc2"
server_key_iv: "7ff46df67a65e1484b52850dace6850f"
server_key_version: "encryptionkey@0"
I20260812 06:28:02.740499 8759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "4fc25f6df2124e1188341709580ed98c"
format_stamp: "Formatted at 2026-08-12 06:28:02 on dist-test-slave-gjrz"
server_key: "d5b5ba1d5a9bb52d315fe7de39da3dc2"
server_key_iv: "7ff46df67a65e1484b52850dace6850f"
server_key_version: "encryptionkey@0"
I20260812 06:28:02.741699 8759 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 06:28:02.742364 8784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:28:02.742532 8759 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:28:02.742612 8759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "4fc25f6df2124e1188341709580ed98c"
format_stamp: "Formatted at 2026-08-12 06:28:02 on dist-test-slave-gjrz"
server_key: "d5b5ba1d5a9bb52d315fe7de39da3dc2"
server_key_iv: "7ff46df67a65e1484b52850dace6850f"
server_key_version: "encryptionkey@0"
I20260812 06:28:02.742671 8759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:28:02.749477 8759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:28:02.751020 8759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:28:02.751144 8759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:28:02.754865 8759 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:46349
I20260812 06:28:02.754894 8905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:46349 every 8 connection(s)
I20260812 06:28:02.755185 8759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:28:02.755962 8907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:28:02.758070 8907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c: Bootstrap starting.
I20260812 06:28:02.758585 8907 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c: Neither blocks nor log segments found. Creating new log.
I20260812 06:28:02.758805 8907 log.cc:824] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:28:02.759080 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 8759
I20260812 06:28:02.759198 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:28:02.759413 30781 external_mini_cluster.cc:1428] Setting key ff9f903770b19f071b75cdf413f017e8
I20260812 06:28:02.759531 8907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c: No bootstrap required, opened a new log
I20260812 06:28:02.762260 8907 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc25f6df2124e1188341709580ed98c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46349 } }
I20260812 06:28:02.762409 8907 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:28:02.762437 8907 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fc25f6df2124e1188341709580ed98c, State: Initialized, Role: FOLLOWER
I20260812 06:28:02.762552 8907 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc25f6df2124e1188341709580ed98c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46349 } }
I20260812 06:28:02.762631 8907 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:28:02.762672 8907 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:28:02.762714 8907 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:28:02.763239 8907 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc25f6df2124e1188341709580ed98c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46349 } }
I20260812 06:28:02.763351 8907 leader_election.cc:302] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fc25f6df2124e1188341709580ed98c; no voters:
I20260812 06:28:02.763499 8907 leader_election.cc:288] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:28:02.763532 8919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:28:02.763687 8919 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [term 1 LEADER]: Becoming Leader. State: Replica: 4fc25f6df2124e1188341709580ed98c, State: Running, Role: LEADER
I20260812 06:28:02.763754 8907 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:28:02.763859 8919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc25f6df2124e1188341709580ed98c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46349 } }
I20260812 06:28:02.764178 8919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fc25f6df2124e1188341709580ed98c. Latest consensus state: current_term: 1 leader_uuid: "4fc25f6df2124e1188341709580ed98c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc25f6df2124e1188341709580ed98c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46349 } } }
I20260812 06:28:02.764251 8919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [sys.catalog]: This master's current role is: LEADER
I20260812 06:28:02.764405 8922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fc25f6df2124e1188341709580ed98c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc25f6df2124e1188341709580ed98c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 46349 } } }
I20260812 06:28:02.764456 8931 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:28:02.764536 8922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c [sys.catalog]: This master's current role is: LEADER
I20260812 06:28:02.765026 8931 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:28:02.765903 8916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:02.759852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47165 (local address 127.30.15.126:46349)
0812 06:28:02.760032 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:02.760041 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:02.760076 (+ 35us) server_negotiation.cc:407] Connection header received
0812 06:28:02.760790 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:02.760798 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:02.760857 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:02.761000 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:02.761158 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:02.762532 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:02.763414 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:02.764020 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:02.764122 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:02.765247 (+ 1125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:02.765251 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:02.765251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:28:02.765429 (+ 178us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:02.765466 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:28:02.765479 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:02.765544 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:02.765641 (+ 97us) server_negotiation.cc:299] Negotiation successful
0812 06:28:02.765703 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
I20260812 06:28:02.766522 8931 catalog_manager.cc:1347] Generated new cluster ID: 29568c9894624925b19a22f9ec57629f
I20260812 06:28:02.766578 8931 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:28:02.766778 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:28:02.774652 8916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:02.771466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41261 (local address 127.30.15.126:46349)
0812 06:28:02.771499 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:02.771501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:02.771622 (+ 121us) server_negotiation.cc:407] Connection header received
0812 06:28:02.771651 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:02.771652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:02.771663 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:02.771716 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:02.771830 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:02.772557 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:02.773508 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:02.773814 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:02.773877 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:02.774440 (+ 563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:02.774442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:02.774442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:28:02.774446 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:02.774461 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:28:02.774465 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:02.774518 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:02.774560 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 06:28:02.774581 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260812 06:28:02.776386 8931 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:28:02.776855 8931 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:28:02.779006 8931 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4fc25f6df2124e1188341709580ed98c: Generated new TSK 0
I20260812 06:28:02.779160 8931 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:28:02.782250 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 8759
2026-08-12T06:28:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1452 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:28:02 dist-test-slave-gjrz krb5kdc[8967](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:28:02 dist-test-slave-gjrz krb5kdc[8967](info): set up 2 sockets
Aug 12 06:28:02 dist-test-slave-gjrz krb5kdc[8967](info): commencing operation
krb5kdc: starting...
W20260812 06:28:03.975178 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:28:04 dist-test-slave-gjrz krb5kdc[8967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:28:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:28:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:28:04.088069 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:33977
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:33977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:28:04.166877 8997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:28:04.167069 8997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:28:04.167090 8997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:28:04.168221 8997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:28:04.168262 8997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:28:04.168274 8997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:28:04.168285 8997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:28:04.168298 8997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:28:04.169737 8997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:33977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:33977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:28:04.169960 8997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:28:04.170154 8997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:28:04.174670 9010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:04.174681 9009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:04.174903 8997 server_base.cc:1034] running on GCE node
W20260812 06:28:04.174681 9016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:04.175148 8997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:28:04.175428 8997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:28:04.176560 8997 hybrid_clock.cc:648] HybridClock initialized: now 1786516084176550 us; error 29 us; skew 500 ppm
Aug 12 06:28:04 dist-test-slave-gjrz krb5kdc[8967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516084, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:28:04.178848 8997 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:28:04.179216 8997 webserver.cc:460] Webserver started at http://127.30.15.126:39647/ using document root <none> and password file <none>
I20260812 06:28:04.179450 8997 fs_manager.cc:359] Metadata directory not provided
I20260812 06:28:04.179494 8997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:28:04.179606 8997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:28:04.180546 8997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "1202298a08b94966b2c4e87b38f9ad9c"
format_stamp: "Formatted at 2026-08-12 06:28:04 on dist-test-slave-gjrz"
server_key: "fc591b6177ec45307365c6fdf5c100ef"
server_key_iv: "923833c231856f17704d9b06dd20a779"
server_key_version: "encryptionkey@0"
I20260812 06:28:04.180858 8997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "1202298a08b94966b2c4e87b38f9ad9c"
format_stamp: "Formatted at 2026-08-12 06:28:04 on dist-test-slave-gjrz"
server_key: "fc591b6177ec45307365c6fdf5c100ef"
server_key_iv: "923833c231856f17704d9b06dd20a779"
server_key_version: "encryptionkey@0"
I20260812 06:28:04.182091 8997 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:28:04.182723 9030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:28:04.182859 8997 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:28:04.182932 8997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "1202298a08b94966b2c4e87b38f9ad9c"
format_stamp: "Formatted at 2026-08-12 06:28:04 on dist-test-slave-gjrz"
server_key: "fc591b6177ec45307365c6fdf5c100ef"
server_key_iv: "923833c231856f17704d9b06dd20a779"
server_key_version: "encryptionkey@0"
I20260812 06:28:04.182997 8997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:28:04.186067 8997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:28:04.187700 8997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:28:04.187808 8997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:28:04.191416 8997 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:33977
I20260812 06:28:04.191459 9140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:33977 every 8 connection(s)
I20260812 06:28:04.191720 8997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:28:04.191939 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 8997
I20260812 06:28:04.192052 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:28:04.192278 30781 external_mini_cluster.cc:1428] Setting key d673314b5dc66f1a594fecd7dfeb2ac5
I20260812 06:28:04.192358 9141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:28:04.194393 9147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:04.192717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42407 (local address 127.30.15.126:33977)
0812 06:28:04.192907 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:04.192916 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:04.192956 (+ 40us) server_negotiation.cc:407] Connection header received
0812 06:28:04.193332 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:04.193340 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:04.193371 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:04.193513 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:04.194021 (+ 508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:04.194024 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:04.194025 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:28:04.194029 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:04.194068 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:28:04.194081 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:04.194153 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:04.194186 (+ 33us) server_negotiation.cc:299] Negotiation successful
0812 06:28:04.194221 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":93,"threads_started":1}
I20260812 06:28:04.195225 9141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c: Bootstrap starting.
I20260812 06:28:04.195235 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:28:04.195783 9141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c: Neither blocks nor log segments found. Creating new log.
I20260812 06:28:04.196013 9141 log.cc:824] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c: Log is configured to *not* fsync() on all Append() calls
I20260812 06:28:04.196640 9141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c: No bootstrap required, opened a new log
I20260812 06:28:04.197414 9147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:04.196554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41265 (local address 127.30.15.126:33977)
0812 06:28:04.196590 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:04.196592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:04.196670 (+ 78us) server_negotiation.cc:407] Connection header received
0812 06:28:04.196723 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:04.196724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:04.196728 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:04.196792 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:04.197236 (+ 444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:04.197237 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:04.197237 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 06:28:04.197241 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:04.197252 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 06:28:04.197256 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:04.197320 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:04.197352 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 06:28:04.197362 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:28:04.198612 9141 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1202298a08b94966b2c4e87b38f9ad9c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 33977 } }
I20260812 06:28:04.198733 9141 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:28:04.198766 9141 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1202298a08b94966b2c4e87b38f9ad9c, State: Initialized, Role: FOLLOWER
I20260812 06:28:04.198869 9141 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1202298a08b94966b2c4e87b38f9ad9c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 33977 } }
I20260812 06:28:04.198951 9141 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:28:04.198982 9141 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:28:04.199028 9141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:28:04.199565 9141 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1202298a08b94966b2c4e87b38f9ad9c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 33977 } }
I20260812 06:28:04.199661 9141 leader_election.cc:302] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1202298a08b94966b2c4e87b38f9ad9c; no voters:
I20260812 06:28:04.199802 9141 leader_election.cc:288] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 06:28:04.199860 9165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:28:04.200013 9165 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [term 1 LEADER]: Becoming Leader. State: Replica: 1202298a08b94966b2c4e87b38f9ad9c, State: Running, Role: LEADER
I20260812 06:28:04.200017 9141 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:28:04.200183 9165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1202298a08b94966b2c4e87b38f9ad9c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 33977 } }
I20260812 06:28:04.200551 9166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1202298a08b94966b2c4e87b38f9ad9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1202298a08b94966b2c4e87b38f9ad9c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 33977 } } }
I20260812 06:28:04.200563 9172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1202298a08b94966b2c4e87b38f9ad9c. Latest consensus state: current_term: 1 leader_uuid: "1202298a08b94966b2c4e87b38f9ad9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1202298a08b94966b2c4e87b38f9ad9c" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 33977 } } }
I20260812 06:28:04.200702 9166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [sys.catalog]: This master's current role is: LEADER
I20260812 06:28:04.200775 9172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c [sys.catalog]: This master's current role is: LEADER
I20260812 06:28:04.201122 9191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:28:04.201519 9191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:28:04.202831 9191 catalog_manager.cc:1347] Generated new cluster ID: 96d22914369f4c86a24f72b450ab9783
I20260812 06:28:04.202880 9191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:28:04.216598 9191 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:28:04.216737 9191 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:28:04.221411 9191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1202298a08b94966b2c4e87b38f9ad9c: Generated new TSK 0
I20260812 06:28:04.221561 9191 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 06:28:04.226665 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 8997
2026-08-12T06:28:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1435 ms)
[----------] 18 tests from AuthTokenIssuingTest (26280 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:28:04 dist-test-slave-gjrz krb5kdc[9219](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:28:04 dist-test-slave-gjrz krb5kdc[9219](info): set up 2 sockets
Aug 12 06:28:04 dist-test-slave-gjrz krb5kdc[9219](info): commencing operation
krb5kdc: starting...
W20260812 06:28:05.408695 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:28:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:28:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:28:05.519730 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:40417
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:35109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:40417,127.30.15.125:35821,127.30.15.124:40365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:28:05.598497 9245 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:28:05.598681 9245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:28:05.598697 9245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:28:05.598716 9245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:28:05.599802 9245 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:28:05.599839 9245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:28:05.599851 9245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:28:05.599874 9245 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:28:05.599896 9245 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:28:05.601297 9245 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:35109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:40417,127.30.15.125:35821,127.30.15.124:40365
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:40417
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:28:05.601501 9245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:28:05.601691 9245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:28:05.606114 9259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:05.606128 9252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:05.606113 9251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:05.606334 9245 server_base.cc:1034] running on GCE node
I20260812 06:28:05.606554 9245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:28:05.606801 9245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:28:05.607939 9245 hybrid_clock.cc:648] HybridClock initialized: now 1786516085607925 us; error 29 us; skew 500 ppm
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:28:05.610186 9245 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:28:05.610556 9245 webserver.cc:460] Webserver started at http://127.30.15.126:35533/ using document root <none> and password file <none>
I20260812 06:28:05.610738 9245 fs_manager.cc:359] Metadata directory not provided
I20260812 06:28:05.610782 9245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:28:05.610900 9245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:28:05.611903 9245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "c6fc755a19ac41e8937492c5914e073a"
format_stamp: "Formatted at 2026-08-12 06:28:05 on dist-test-slave-gjrz"
server_key: "bbbc458a00c84ee4e743d9d662ab26fc"
server_key_iv: "26ed6253435d09b5e5f5ca31570ecea7"
server_key_version: "encryptionkey@0"
I20260812 06:28:05.612226 9245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "c6fc755a19ac41e8937492c5914e073a"
format_stamp: "Formatted at 2026-08-12 06:28:05 on dist-test-slave-gjrz"
server_key: "bbbc458a00c84ee4e743d9d662ab26fc"
server_key_iv: "26ed6253435d09b5e5f5ca31570ecea7"
server_key_version: "encryptionkey@0"
I20260812 06:28:05.613425 9245 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:28:05.614089 9273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:28:05.614238 9245 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:28:05.614318 9245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "c6fc755a19ac41e8937492c5914e073a"
format_stamp: "Formatted at 2026-08-12 06:28:05 on dist-test-slave-gjrz"
server_key: "bbbc458a00c84ee4e743d9d662ab26fc"
server_key_iv: "26ed6253435d09b5e5f5ca31570ecea7"
server_key_version: "encryptionkey@0"
I20260812 06:28:05.614384 9245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:28:05.628527 9245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:28:05.630051 9245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:28:05.630172 9245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:28:05.633880 9245 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:40417
I20260812 06:28:05.633919 9403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:40417 every 8 connection(s)
I20260812 06:28:05.634207 9245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:28:05.635133 9404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:28:05.636572 9404 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:28:05.643747 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 9245
I20260812 06:28:05.643862 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:28:05.644019 30781 external_mini_cluster.cc:1428] Setting key 91966fa02ae264cecd69f3fc48810cd6
I20260812 06:28:05.645150 9411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.637216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34044 (local address 127.30.15.126:40417)
0812 06:28:05.637368 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.637376 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.637456 (+ 80us) server_negotiation.cc:407] Connection header received
0812 06:28:05.637907 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.637909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.637924 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.637998 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.638468 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.639296 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.640089 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.640382 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.640453 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.642226 (+ 1773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.642234 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.642234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.642239 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.643641 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.644032 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.644034 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.644034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.644127 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.644321 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.644322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.644323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.644519 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.644596 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.644782 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.644889 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":79,"threads_started":1}
I20260812 06:28:05.645150 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.637191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:40417 (local address 127.0.0.1:34044)
0812 06:28:05.637350 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.637386 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:05.637802 (+ 416us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:05.638010 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:05.638012 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:05.638245 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:05.638404 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.638408 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.639366 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.639366 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.640013 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.640014 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.640453 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.640453 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.640504 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.640877 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:05.640885 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:05.642153 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:05.643716 (+ 1563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.643722 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.643723 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.643958 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.644182 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.644183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.644183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.644268 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.644586 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:05.644591 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:05.644654 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 06:28:05.644735 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 06:28:05.644960 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":88,"thread_start_us":75,"threads_started":1}
I20260812 06:28:05.646006 9404 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:28:05.646306 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.646205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:35821 (local address 127.0.0.1:52212)
0812 06:28:05.646243 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.646285 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:35821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 06:28:05.646421 9278 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.15.125:35821: connect: Connection refused (error 111)
I20260812 06:28:05.646842 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.646761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:35821 (local address 127.0.0.1:52220)
0812 06:28:05.646801 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.646825 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:35821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260812 06:28:05.646939 9404 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.125:35821: Network error: Client connection negotiation failed: client connection to 127.30.15.125:35821: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.30.15.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.125.keytab.
Entry for principal kudu/127.30.15.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.125.keytab.
I20260812 06:28:05.667480 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.125:35821
--webserver_interface=127.30.15.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.125.keytab
--principal=kudu/127.30.15.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:35109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:40417,127.30.15.125:35821,127.30.15.124:40365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:28:05.696151 9404 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } attempt: 1
I20260812 06:28:05.696569 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.696445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:35821 (local address 127.0.0.1:52234)
0812 06:28:05.696501 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.696539 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:35821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260812 06:28:05.696895 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.696818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:35821 (local address 127.0.0.1:52242)
0812 06:28:05.696856 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.696879 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:35821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 06:28:05.696974 9404 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.125:35821: Network error: Client connection negotiation failed: client connection to 127.30.15.125:35821: connect: Connection refused (error 111)
W20260812 06:28:05.746768 9419 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:28:05.746953 9419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:28:05.746968 9419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:28:05.746986 9419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:28:05.748085 9419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:28:05.748126 9419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:28:05.748138 9419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:28:05.748149 9419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:28:05.748165 9419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:28:05.749565 9419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:35109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:40417,127.30.15.125:35821,127.30.15.124:40365
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.125.keytab
--principal=kudu/127.30.15.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.125:35821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.15.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:28:05.749742 9419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:28:05.749903 9419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:28:05.754348 9429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:05.754462 9419 server_base.cc:1034] running on GCE node
W20260812 06:28:05.754333 9432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:05.754328 9430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:05.754786 9419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:28:05.755038 9419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:28:05.756175 9419 hybrid_clock.cc:648] HybridClock initialized: now 1786516085756163 us; error 28 us; skew 500 ppm
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:28:05.758359 9419 init.cc:377] Logged in from keytab as kudu/127.30.15.125@KRBTEST.COM (short username kudu)
I20260812 06:28:05.758762 9419 webserver.cc:460] Webserver started at http://127.30.15.125:39297/ using document root <none> and password file <none>
I20260812 06:28:05.758955 9419 fs_manager.cc:359] Metadata directory not provided
I20260812 06:28:05.759001 9419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:28:05.759124 9419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:28:05.760124 9419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/data/instance:
uuid: "5c8681af2d1e4c9ca8d6668b70c399f3"
format_stamp: "Formatted at 2026-08-12 06:28:05 on dist-test-slave-gjrz"
server_key: "341ed9349c6b4fd9408741e96355ad4e"
server_key_iv: "47ab2d5ce6aee851a4b7ddfe4a4d4eb0"
server_key_version: "encryptionkey@0"
I20260812 06:28:05.760447 9419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/wal/instance:
uuid: "5c8681af2d1e4c9ca8d6668b70c399f3"
format_stamp: "Formatted at 2026-08-12 06:28:05 on dist-test-slave-gjrz"
server_key: "341ed9349c6b4fd9408741e96355ad4e"
server_key_iv: "47ab2d5ce6aee851a4b7ddfe4a4d4eb0"
server_key_version: "encryptionkey@0"
I20260812 06:28:05.761629 9419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:28:05.762290 9454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:28:05.762436 9419 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:28:05.762517 9419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/wal
uuid: "5c8681af2d1e4c9ca8d6668b70c399f3"
format_stamp: "Formatted at 2026-08-12 06:28:05 on dist-test-slave-gjrz"
server_key: "341ed9349c6b4fd9408741e96355ad4e"
server_key_iv: "47ab2d5ce6aee851a4b7ddfe4a4d4eb0"
server_key_version: "encryptionkey@0"
I20260812 06:28:05.762581 9419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:28:05.765122 9404 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } attempt: 2
I20260812 06:28:05.765439 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.765339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:35821 (local address 127.0.0.1:52250)
0812 06:28:05.765386 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.765414 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:35821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 06:28:05.765786 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.765704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:35821 (local address 127.0.0.1:52266)
0812 06:28:05.765737 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.765762 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:35821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260812 06:28:05.765874 9404 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.125:35821: Network error: Client connection negotiation failed: client connection to 127.30.15.125:35821: connect: Connection refused (error 111)
I20260812 06:28:05.784224 9419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:28:05.785738 9419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:28:05.785851 9419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:28:05.789619 9419 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.125:35821
I20260812 06:28:05.789649 9561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.125:35821 every 8 connection(s)
I20260812 06:28:05.789929 9419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
I20260812 06:28:05.790798 9563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:28:05.791734 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 9419
I20260812 06:28:05.791819 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-1/wal/instance
I20260812 06:28:05.791960 30781 external_mini_cluster.cc:1428] Setting key 1e34f31eb64165f36aad6bc3497f8764
I20260812 06:28:05.792327 9563 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.125@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.15.124@KRBTEST.COM; defaulting to no policy
I20260812 06:28:05.800391 9411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.792948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34058 (local address 127.30.15.126:40417)
0812 06:28:05.792994 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.792996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.793218 (+ 222us) server_negotiation.cc:407] Connection header received
0812 06:28:05.793669 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.793671 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.793688 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.793739 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.794295 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.794764 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.795746 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.795945 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.796001 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.797900 (+ 1899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.797901 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.797902 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.797910 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.799139 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.799528 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.799529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.799530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.799594 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.799809 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.799810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.799810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.799920 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.799977 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.800221 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.800308 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260812 06:28:05.800576 9565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.792933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:40417 (local address 127.0.0.1:34058)
0812 06:28:05.793099 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.793130 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:05.793570 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:05.793809 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:05.793813 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:05.794027 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:05.794204 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.794207 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.794844 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.794845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.795662 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.795664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.796031 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.796032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.796144 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.796579 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:05.796587 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:05.797814 (+ 1227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:05.799210 (+ 1396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.799217 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.799219 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.799462 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.799651 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.799652 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.799652 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.799752 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.799975 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:05.799982 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:05.800106 (+ 124us) client_negotiation.cc:769] Sending connection context
0812 06:28:05.800189 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 06:28:05.800368 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":79,"threads_started":1}
I20260812 06:28:05.801036 9563 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.124@KRBTEST.COM" created.
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.125@KRBTEST.COM for kudu/127.30.15.125@KRBTEST.COM
I20260812 06:28:05.808192 9565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.801243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:35821 (local address 127.0.0.1:52272)
0812 06:28:05.801316 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.801327 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:05.801357 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:05.801594 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:05.801594 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:05.801692 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:05.801738 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.801739 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.802716 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.802717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.803448 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.803451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.804081 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.804081 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.804132 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.804464 (+ 332us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:05.804468 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:05.805591 (+ 1123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:05.807344 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.807345 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.807346 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.807506 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.807704 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.807704 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.807704 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.807747 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.807999 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:05.808000 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:05.808032 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 06:28:05.808076 (+ 44us) client_negotiation.cc:240] Negotiation successful
0812 06:28:05.808136 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260812 06:28:05.808290 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.801274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52272 (local address 127.30.15.125:35821)
0812 06:28:05.801475 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.801479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.801494 (+ 15us) server_negotiation.cc:407] Connection header received
0812 06:28:05.801513 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.801514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.801525 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.801590 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.801787 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.802638 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.803557 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.804010 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.804084 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.805668 (+ 1584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.805676 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.805676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.805681 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.807249 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.807579 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.807582 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.807582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.807646 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.807783 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.807784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.807784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.807942 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.808025 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.808119 (+ 94us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.808197 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":67,"threads_started":1}
I20260812 06:28:05.808773 9563 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:28:05.809082 9565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.808960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:40365 (local address 127.0.0.1:45628)
0812 06:28:05.809005 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.809060 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 06:28:05.809201 9456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
I20260812 06:28:05.809562 9565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.809470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:40365 (local address 127.0.0.1:45630)
0812 06:28:05.809512 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.809540 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260812 06:28:05.809659 9563 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:40365: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.124.keytab.
Entry for principal kudu/127.30.15.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.124.keytab.
I20260812 06:28:05.815649 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.124:40365
--webserver_interface=127.30.15.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.124.keytab
--principal=kudu/127.30.15.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:35109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:40417,127.30.15.125:35821,127.30.15.124:40365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:28:05.857015 9404 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } attempt: 3
I20260812 06:28:05.858868 9563 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } attempt: 1
I20260812 06:28:05.859207 9565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.859089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:40365 (local address 127.0.0.1:45640)
0812 06:28:05.859138 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.859174 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260812 06:28:05.859709 9565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.859419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:40365 (local address 127.0.0.1:45646)
0812 06:28:05.859654 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.859684 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217}
W20260812 06:28:05.859790 9563 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:40365: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.125@KRBTEST.COM
I20260812 06:28:05.863364 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.857369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52282 (local address 127.30.15.125:35821)
0812 06:28:05.857428 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.857430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.857440 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:28:05.857495 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.857496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.857508 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.857563 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.857842 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.858317 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.858997 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.859329 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.859423 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.861239 (+ 1816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.861240 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.861241 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.861247 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.862404 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.862694 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.862695 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.862695 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.862742 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.862901 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.862902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.862902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.863001 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.863057 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.863194 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.863259 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:28:05.863374 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.857319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:35821 (local address 127.0.0.1:52282)
0812 06:28:05.857375 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.857385 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:05.857435 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:05.857573 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:05.857574 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:05.857714 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:05.857774 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.857777 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.858386 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.858387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.858925 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.858928 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.859440 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.859441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.859513 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.859905 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:05.859910 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:05.861166 (+ 1256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:05.862476 (+ 1310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.862477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.862478 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.862635 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.862794 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.862795 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.862795 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.862851 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.863062 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:05.863063 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:05.863108 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 06:28:05.863166 (+ 58us) client_negotiation.cc:240] Negotiation successful
0812 06:28:05.863259 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260812 06:28:05.863783 9404 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:28:05.864061 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.863971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:40365 (local address 127.0.0.1:45654)
0812 06:28:05.864012 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.864038 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:28:05.864338 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.864259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:40365 (local address 127.0.0.1:45660)
0812 06:28:05.864295 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.864318 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 06:28:05.864423 9404 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:40365: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
I20260812 06:28:05.895545 9404 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } attempt: 1
I20260812 06:28:05.895906 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.895801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:40365 (local address 127.0.0.1:45676)
0812 06:28:05.895847 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.895876 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:28:05.896194 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.896112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:40365 (local address 127.0.0.1:45690)
0812 06:28:05.896147 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.896171 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260812 06:28:05.896090 9573 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:28:05.896270 9573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:28:05.896270 9404 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:40365: Network error: Client connection negotiation failed: client connection to 127.30.15.124:40365: connect: Connection refused (error 111)
W20260812 06:28:05.896308 9573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:28:05.896334 9573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:28:05.897431 9573 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:28:05.897467 9573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:28:05.897480 9573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:28:05.897491 9573 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:28:05.897501 9573 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:28:05.898917 9573 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:35109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:40417,127.30.15.125:35821,127.30.15.124:40365
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.124.keytab
--principal=kudu/127.30.15.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.124:40365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.15.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9573
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:28:05.899130 9573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:28:05.899358 9573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:28:05.903795 9583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:05.903792 9587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:05.903911 9573 server_base.cc:1034] running on GCE node
W20260812 06:28:05.904023 9580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:05.904301 9573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:28:05.904531 9573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:28:05.905668 9573 hybrid_clock.cc:648] HybridClock initialized: now 1786516085905656 us; error 26 us; skew 500 ppm
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:28:05.907930 9573 init.cc:377] Logged in from keytab as kudu/127.30.15.124@KRBTEST.COM (short username kudu)
I20260812 06:28:05.908320 9573 webserver.cc:460] Webserver started at http://127.30.15.124:33947/ using document root <none> and password file <none>
I20260812 06:28:05.908505 9573 fs_manager.cc:359] Metadata directory not provided
I20260812 06:28:05.908560 9573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:28:05.908682 9573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:28:05.909677 9573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/data/instance:
uuid: "7f03cff76ded41309462a27e6bbd62f0"
format_stamp: "Formatted at 2026-08-12 06:28:05 on dist-test-slave-gjrz"
server_key: "472caf45534a53956e92db11bd172bd7"
server_key_iv: "d09ea0bd8f201f639a406052f38fe514"
server_key_version: "encryptionkey@0"
I20260812 06:28:05.909991 9573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/wal/instance:
uuid: "7f03cff76ded41309462a27e6bbd62f0"
format_stamp: "Formatted at 2026-08-12 06:28:05 on dist-test-slave-gjrz"
server_key: "472caf45534a53956e92db11bd172bd7"
server_key_iv: "d09ea0bd8f201f639a406052f38fe514"
server_key_version: "encryptionkey@0"
I20260812 06:28:05.911157 9573 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260812 06:28:05.911839 9599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:28:05.911985 9573 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260812 06:28:05.912066 9573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/wal
uuid: "7f03cff76ded41309462a27e6bbd62f0"
format_stamp: "Formatted at 2026-08-12 06:28:05 on dist-test-slave-gjrz"
server_key: "472caf45534a53956e92db11bd172bd7"
server_key_iv: "d09ea0bd8f201f639a406052f38fe514"
server_key_version: "encryptionkey@0"
I20260812 06:28:05.912130 9573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:28:05.922204 9573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:28:05.923753 9573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:28:05.923864 9573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:28:05.927570 9573 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.124:40365
I20260812 06:28:05.927760 9710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.124:40365 every 8 connection(s)
I20260812 06:28:05.927918 9573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
I20260812 06:28:05.927903 9563 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } attempt: 2
I20260812 06:28:05.929100 9715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:28:05.929714 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 9573
I20260812 06:28:05.929796 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786515816548244-30781-0/minicluster-data/master-2/wal/instance
I20260812 06:28:05.929971 30781 external_mini_cluster.cc:1428] Setting key 6d06856f796079bf44b8f13b973d01fd
I20260812 06:28:05.930889 9715 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.125@KRBTEST.COM for kudu/127.30.15.124@KRBTEST.COM
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.124@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.124@KRBTEST.COM
I20260812 06:28:05.938315 9565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.928167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:40365 (local address 127.0.0.1:45702)
0812 06:28:05.928227 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.928236 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:05.928278 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:05.929398 (+ 1120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:05.929400 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:05.929560 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:05.929614 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.929617 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.931170 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.931171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.931897 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.931901 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.932663 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.932664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.932730 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.933122 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:05.933127 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:05.934635 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:05.936647 (+ 2012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.936648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.936649 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.936869 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.937141 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.937142 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.937143 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.937215 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.937956 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:05.937957 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:05.938013 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 06:28:05.938091 (+ 78us) client_negotiation.cc:240] Negotiation successful
0812 06:28:05.938200 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 06:28:05.938504 9717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.928294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45702 (local address 127.30.15.124:40365)
0812 06:28:05.928779 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.928786 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.928810 (+ 24us) server_negotiation.cc:407] Connection header received
0812 06:28:05.929229 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.929236 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.929280 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.929399 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.929730 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.931069 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.931986 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.932580 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.932681 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.934719 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.934725 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.934725 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.934733 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.936579 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.936969 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.936972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.936973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.937067 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.937271 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.937272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.937272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.937562 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.937653 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.938178 (+ 525us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.938296 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":397,"threads_started":1}
I20260812 06:28:05.939783 9411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.931696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34064 (local address 127.30.15.126:40417)
0812 06:28:05.931749 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.931751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.931885 (+ 134us) server_negotiation.cc:407] Connection header received
0812 06:28:05.931955 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.931956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.931966 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.932016 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.932465 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.933120 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.933853 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.934094 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.934151 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.936929 (+ 2778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.936930 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.936931 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.936937 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.938271 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.938966 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.938967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.938967 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.939028 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.939209 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.939210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.939211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.939360 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.939420 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.939624 (+ 204us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.939699 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260812 06:28:05.940099 9721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.931543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:40417 (local address 127.0.0.1:34064)
0812 06:28:05.931777 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.931820 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:05.931891 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:05.932052 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:05.932056 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:05.932297 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:05.932379 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.932381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.933184 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.933185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.933763 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.933766 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.934194 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.934195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.934272 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.934724 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:05.934733 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:05.936852 (+ 2119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:05.938356 (+ 1504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.938362 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.938364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.938897 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.939091 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.939092 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.939092 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.939156 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.939420 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:05.939427 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:05.939476 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 06:28:05.939895 (+ 419us) client_negotiation.cc:240] Negotiation successful
0812 06:28:05.940001 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":74,"threads_started":1}
I20260812 06:28:05.940343 9563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3: Bootstrap starting.
I20260812 06:28:05.940410 9718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.930286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45718 (local address 127.30.15.124:40365)
0812 06:28:05.931235 (+ 949us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.931236 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.931420 (+ 184us) server_negotiation.cc:407] Connection header received
0812 06:28:05.931515 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.931516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.931526 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.931585 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.932298 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.932971 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.933916 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.934216 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.934272 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.936996 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.936997 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.936997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.937002 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.939082 (+ 2080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.939484 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.939484 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.939485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.939538 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.939734 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.939735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.939735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.939850 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.939968 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.940212 (+ 244us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.940290 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":7,"server-negotiator.queue_time_us":930,"thread_start_us":94,"threads_started":1}
I20260812 06:28:05.941273 9563 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3: Neither blocks nor log segments found. Creating new log.
I20260812 06:28:05.941562 9563 log.cc:824] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3: Log is configured to *not* fsync() on all Append() calls
I20260812 06:28:05.942210 9715 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:28:05.942346 9563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3: No bootstrap required, opened a new log
I20260812 06:28:05.944248 9563 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } }
I20260812 06:28:05.944355 9563 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8681af2d1e4c9ca8d6668b70c399f3, State: Initialized, Role: FOLLOWER
I20260812 06:28:05.944427 9563 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } }
I20260812 06:28:05.944659 9724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } } }
I20260812 06:28:05.944725 9563 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:28:05.944813 9724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [sys.catalog]: This master's current role is: FOLLOWER
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.124@KRBTEST.COM for kudu/127.30.15.125@KRBTEST.COM
W20260812 06:28:05.946611 9741 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:28:05.946689 9741 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:28:05.948597 9411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.940968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34072 (local address 127.30.15.126:40417)
0812 06:28:05.941000 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.941002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.941010 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:28:05.941077 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.941077 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.941086 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.941129 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.941589 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.942152 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.943179 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.943474 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.943535 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.945901 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.945902 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.945903 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.945910 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.947473 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.947812 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.947813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.947814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.947868 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.948068 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.948070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.948070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.948215 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.948388 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.948426 (+ 38us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.948499 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:28:05.946880 9419 master_runner.cc:186] Error getting master registration for 127.30.15.126:40417: OK, instance_id { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" instance_seqno: 1786516085632895 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:28:05.949556 9419 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:28:05.949708 9721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.942431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:35821 (local address 127.0.0.1:52290)
0812 06:28:05.942467 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.942480 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:05.942519 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:05.942641 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:05.942641 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:05.942774 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:05.942827 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.942828 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.943743 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.943744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.944423 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.944426 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.944950 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.944951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.945018 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.945358 (+ 340us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:05.945363 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:05.946966 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:05.948577 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.948578 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.948578 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.948837 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.949054 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.949055 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.949055 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.949124 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.949416 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:05.949417 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:05.949461 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 06:28:05.949532 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:28:05.949630 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260812 06:28:05.949734 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.942480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52290 (local address 127.30.15.125:35821)
0812 06:28:05.942519 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.942520 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.942529 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:28:05.942575 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.942576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.942584 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.942636 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.942892 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.943481 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.944532 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.944831 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.944872 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.947033 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.947034 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.947034 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.947041 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.948484 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.948921 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.948923 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.948923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.948982 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.949220 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.949221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.949221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.949353 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.949406 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.949595 (+ 189us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.949669 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:28:05.950314 9715 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.125@KRBTEST.COM
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.124@KRBTEST.COM for kudu/127.30.15.124@KRBTEST.COM
I20260812 06:28:05.956570 9568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.949143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52304 (local address 127.30.15.125:35821)
0812 06:28:05.949791 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.949793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.949799 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:28:05.949815 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.949816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.949824 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.949879 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.950407 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.950993 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.951707 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.951897 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.951948 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.954247 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.954248 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.954249 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.954255 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.955541 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.955854 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.955855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.955856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.955923 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.956118 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.956118 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.956119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.956217 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.956340 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.956418 (+ 78us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.956488 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":71,"threads_started":1}
I20260812 06:28:05.957744 9721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.950508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:40365 (local address 127.0.0.1:45730)
0812 06:28:05.950566 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.950576 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:05.950612 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:05.950754 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:05.950755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:05.950885 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:05.950915 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.950917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.951765 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.951766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.952491 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.952494 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.952992 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.952993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.953048 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.953877 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:05.953882 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:05.955130 (+ 1248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:05.956810 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.956811 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.956811 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.956994 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.957179 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.957179 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.957180 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.957227 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.957475 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:05.957475 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:05.957507 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 06:28:05.957578 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 06:28:05.957659 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260812 06:28:05.957850 9718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.950629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45730 (local address 127.30.15.124:40365)
0812 06:28:05.950658 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.950660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.950666 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:28:05.950684 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.950684 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.950692 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.950743 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.950992 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.951680 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.952600 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.952920 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.952987 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.955217 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.955218 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.955219 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.955224 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.956731 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.957064 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.957065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.957065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.957119 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.957286 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.957286 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.957286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.957402 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.957438 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.957681 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.957769 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:28:05.959131 9715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0: Bootstrap starting.
I20260812 06:28:05.959753 9715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0: Neither blocks nor log segments found. Creating new log.
I20260812 06:28:05.960013 9715 log.cc:824] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0: Log is configured to *not* fsync() on all Append() calls
I20260812 06:28:05.960323 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:28:05.961354 9715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0: No bootstrap required, opened a new log
I20260812 06:28:05.961370 9345 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c6fc755a19ac41e8937492c5914e073a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34072
I20260812 06:28:05.963352 9715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } }
I20260812 06:28:05.963485 9715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f03cff76ded41309462a27e6bbd62f0, State: Initialized, Role: FOLLOWER
I20260812 06:28:05.963553 9715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } }
I20260812 06:28:05.963848 9715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:28:05.963809 9746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } } }
I20260812 06:28:05.964005 9746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 06:28:05.965929 9767 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:28:05.966007 9767 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:28:05.965840 9573 master_runner.cc:186] Error getting master registration for 127.30.15.126:40417: OK, instance_id { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" instance_seqno: 1786516085632895 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:28:05.968046 9573 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:28:05.971390 9404 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } attempt: 2
Aug 12 06:28:05 dist-test-slave-gjrz krb5kdc[9219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.124@KRBTEST.COM
I20260812 06:28:05.978838 9408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.971639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:40365 (local address 127.0.0.1:45746)
0812 06:28:05.971684 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:05.971695 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:05.971730 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:05.971866 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:05.971868 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:05.972043 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:05.972086 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.972088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.972940 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.972941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.973740 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:05.973743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.974204 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.974205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:05.974258 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.974659 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:05.974663 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:05.976058 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:05.977808 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.977809 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.977810 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.978020 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.978221 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:05.978222 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:05.978222 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:05.978288 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:05.978548 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:05.978549 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:05.978593 (+ 44us) client_negotiation.cc:769] Sending connection context
0812 06:28:05.978650 (+ 57us) client_negotiation.cc:240] Negotiation successful
0812 06:28:05.978744 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260812 06:28:05.979394 9718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.971671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45746 (local address 127.30.15.124:40365)
0812 06:28:05.971716 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.971718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.971726 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:28:05.971799 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.971800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.971809 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.971858 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.972170 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.972864 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.973827 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.974117 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.974191 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.976140 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.976141 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.976142 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.976149 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.977735 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.978089 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.978090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.978090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.978144 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.978350 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.978351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.978351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.978468 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.978522 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.979199 (+ 677us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.979308 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260812 06:28:05.980993 9404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a: Bootstrap starting.
I20260812 06:28:05.981678 9404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a: Neither blocks nor log segments found. Creating new log.
I20260812 06:28:05.981982 9404 log.cc:824] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:28:05.982829 9404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a: No bootstrap required, opened a new log
I20260812 06:28:05.984193 9404 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } }
I20260812 06:28:05.984315 9404 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6fc755a19ac41e8937492c5914e073a, State: Initialized, Role: FOLLOWER
I20260812 06:28:05.984380 9404 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } }
I20260812 06:28:05.984697 9345 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:28:05.984792 9345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:28:05.985498 9345 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } }
I20260812 06:28:05.985733 9345 leader_election.cc:288] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [CANDIDATE]: Term 1 election: Requested vote from peers 5c8681af2d1e4c9ca8d6668b70c399f3 (127.30.15.125:35821), 7f03cff76ded41309462a27e6bbd62f0 (127.30.15.124:40365)
I20260812 06:28:05.984670 9404 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:28:05.986212 9509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6fc755a19ac41e8937492c5914e073a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3"
I20260812 06:28:05.986367 9509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:28:05.987396 9659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6fc755a19ac41e8937492c5914e073a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7f03cff76ded41309462a27e6bbd62f0"
I20260812 06:28:05.987514 9659 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:28:05.984660 9772 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } } }
I20260812 06:28:05.988137 9772 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:28:05.988358 9659 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6fc755a19ac41e8937492c5914e073a in term 1.
I20260812 06:28:05.988570 9278 leader_election.cc:302] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f03cff76ded41309462a27e6bbd62f0, c6fc755a19ac41e8937492c5914e073a; no voters:
I20260812 06:28:05.988705 9772 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:28:05.988878 9772 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [term 1 LEADER]: Becoming Leader. State: Replica: c6fc755a19ac41e8937492c5914e073a, State: Running, Role: LEADER
I20260812 06:28:05.989027 9772 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } }
I20260812 06:28:05.987232 9509 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6fc755a19ac41e8937492c5914e073a in term 1.
I20260812 06:28:05.989440 9772 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6fc755a19ac41e8937492c5914e073a. Latest consensus state: current_term: 1 leader_uuid: "c6fc755a19ac41e8937492c5914e073a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } } }
I20260812 06:28:05.989502 9772 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [sys.catalog]: This master's current role is: LEADER
I20260812 06:28:05.991500 9245 master_runner.cc:263] No leader master found from master c6fc755a19ac41e8937492c5914e073a
I20260812 06:28:05.991555 9245 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 06:28:05.996001 9800 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:28:05.996111 9800 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:28:05.998837 9411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.990373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34086 (local address 127.30.15.126:40417)
0812 06:28:05.990409 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.990410 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.991095 (+ 685us) server_negotiation.cc:407] Connection header received
0812 06:28:05.991186 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.991187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.991196 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.991224 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.991967 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.992662 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.993706 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.993998 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.994033 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.995484 (+ 1451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.995486 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.995486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.995493 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.997190 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.997574 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.997575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.997576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.997628 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.997810 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.997811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.997811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.997925 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:05.998445 (+ 520us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:05.998678 (+ 233us) server_negotiation.cc:299] Negotiation successful
0812 06:28:05.998751 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:28:06.000711 9743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.990583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52310 (local address 127.30.15.125:35821)
0812 06:28:05.990625 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.990626 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.992056 (+ 1430us) server_negotiation.cc:407] Connection header received
0812 06:28:05.992146 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.992147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.992157 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.992197 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.992896 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.993677 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.994681 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.995011 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.995049 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:05.997312 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:05.997313 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:05.997314 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:05.997320 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:05.999114 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:05.999874 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:05.999876 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:05.999876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:05.999930 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:06.000138 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:06.000139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:06.000139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:06.000258 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:06.000332 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:06.000518 (+ 186us) server_negotiation.cc:299] Negotiation successful
0812 06:28:06.000597 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260812 06:28:06.003331 9815 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:28:06.003568 9815 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:28:06.005105 9509 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [term 1 FOLLOWER]: Refusing update from remote peer c6fc755a19ac41e8937492c5914e073a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:28:06.005339 9659 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [term 1 FOLLOWER]: Refusing update from remote peer c6fc755a19ac41e8937492c5914e073a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:28:06.005740 9772 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:28:06.005870 9772 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:28:06.008335 9724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6fc755a19ac41e8937492c5914e073a. Latest consensus state: current_term: 1 leader_uuid: "c6fc755a19ac41e8937492c5914e073a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } } }
I20260812 06:28:06.008415 9724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:28:06.009423 9746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6fc755a19ac41e8937492c5914e073a. Latest consensus state: current_term: 1 leader_uuid: "c6fc755a19ac41e8937492c5914e073a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } } }
I20260812 06:28:06.009527 9746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:28:06.009841 9803 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6fc755a19ac41e8937492c5914e073a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } } }
I20260812 06:28:06.009929 9803 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [sys.catalog]: This master's current role is: LEADER
I20260812 06:28:06.010376 9746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6fc755a19ac41e8937492c5914e073a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } } }
I20260812 06:28:06.010453 9746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:28:06.010584 9822 mvcc.cc:205] Tried to move back new op lower bound from 7317569888274255872 to 7317569888211877888. Current Snapshot: MvccSnapshot[applied={T|T < 7317569888274255872}]
I20260812 06:28:06.010797 9718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:05.990855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45748 (local address 127.30.15.124:40365)
0812 06:28:05.990886 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:05.990887 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:05.995391 (+ 4504us) server_negotiation.cc:407] Connection header received
0812 06:28:05.995502 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:05.995503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:05.995513 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:05.995541 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:05.996134 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.996774 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.997704 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:05.997990 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:05.998032 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:06.007491 (+ 9459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:06.007493 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:06.007493 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:06.007500 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:06.009143 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:06.009965 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:06.009966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:06.009966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:06.010023 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:06.010219 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:06.010220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:06.010220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:06.010341 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:06.010406 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:06.010630 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 06:28:06.010710 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:28:06.010953 9772 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6fc755a19ac41e8937492c5914e073a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } } }
I20260812 06:28:06.011045 9772 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a [sys.catalog]: This master's current role is: LEADER
I20260812 06:28:06.011435 9724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6fc755a19ac41e8937492c5914e073a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6fc755a19ac41e8937492c5914e073a" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 40417 } } peers { permanent_uuid: "5c8681af2d1e4c9ca8d6668b70c399f3" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 35821 } } peers { permanent_uuid: "7f03cff76ded41309462a27e6bbd62f0" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 40365 } } }
I20260812 06:28:06.011507 9724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:28:06.012145 9825 mvcc.cc:205] Tried to move back new op lower bound from 7317569888274255872 to 7317569888211877888. Current Snapshot: MvccSnapshot[applied={T|T < 7317569888274255872}]
I20260812 06:28:06.012581 9824 mvcc.cc:205] Tried to move back new op lower bound from 7317569888274255872 to 7317569888211877888. Current Snapshot: MvccSnapshot[applied={T|T < 7317569888274255872}]
I20260812 06:28:06.013021 9815 catalog_manager.cc:1347] Generated new cluster ID: b153d0113b0f4a1e8c5d9205a8a9a4ca
I20260812 06:28:06.013062 9815 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:28:06.024147 9815 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:28:06.024899 9815 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:28:06.040783 9815 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6fc755a19ac41e8937492c5914e073a: Generated new TSK 0
I20260812 06:28:06.041004 9815 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:28:06.068632 9411 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.066980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34100 (local address 127.30.15.126:40417)
0812 06:28:06.067023 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.067025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.067989 (+ 964us) server_negotiation.cc:407] Connection header received
0812 06:28:06.068096 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.068097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.068108 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.068137 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.068566 (+ 429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34100: BlockingRecv error: recv got EOF from 127.0.0.1:34100 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 06:28:06.069540 9743 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.067376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52320 (local address 127.30.15.125:35821)
0812 06:28:06.067416 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.067418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.069048 (+ 1630us) server_negotiation.cc:407] Connection header received
0812 06:28:06.069141 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.069142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.069152 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.069178 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.069482 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52320: BlockingRecv error: recv got EOF from 127.0.0.1:52320 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 06:28:06.070338 9718 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.067688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45764 (local address 127.30.15.124:40365)
0812 06:28:06.067727 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.067729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.069855 (+ 2126us) server_negotiation.cc:407] Connection header received
0812 06:28:06.069960 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.069960 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.069970 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.069998 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.070282 (+ 284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45764: BlockingRecv error: recv got EOF from 127.0.0.1:45764 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 06:28:06.072666 9743 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.071945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52322 (local address 127.30.15.125:35821)
0812 06:28:06.071978 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.071980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.072190 (+ 210us) server_negotiation.cc:407] Connection header received
0812 06:28:06.072285 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.072286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.072301 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.072327 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.072626 (+ 299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52322: BlockingRecv error: recv got EOF from 127.0.0.1:52322 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260812 06:28:06.075693 9743 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.074941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52330 (local address 127.30.15.125:35821)
0812 06:28:06.074973 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.074975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.075190 (+ 215us) server_negotiation.cc:407] Connection header received
0812 06:28:06.075301 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.075302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.075312 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.075339 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.075653 (+ 314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52330: BlockingRecv error: recv got EOF from 127.0.0.1:52330 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 06:28:06.079579 9743 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.078839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52332 (local address 127.30.15.125:35821)
0812 06:28:06.078872 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.078874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.079111 (+ 237us) server_negotiation.cc:407] Connection header received
0812 06:28:06.079189 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.079189 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.079198 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.079222 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.079538 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52332: BlockingRecv error: recv got EOF from 127.0.0.1:52332 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 06:28:06.085530 9743 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.084718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52346 (local address 127.30.15.125:35821)
0812 06:28:06.084752 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.084765 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.085026 (+ 261us) server_negotiation.cc:407] Connection header received
0812 06:28:06.085120 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.085121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.085131 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.085158 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.085488 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52346: BlockingRecv error: recv got EOF from 127.0.0.1:52346 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 06:28:06.095496 9743 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.094687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52356 (local address 127.30.15.125:35821)
0812 06:28:06.094718 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.094720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.094963 (+ 243us) server_negotiation.cc:407] Connection header received
0812 06:28:06.095065 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.095066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.095076 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.095103 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.095451 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52356: BlockingRecv error: recv got EOF from 127.0.0.1:52356 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 06:28:06.113302 9743 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.112697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52364 (local address 127.30.15.125:35821)
0812 06:28:06.112740 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.112742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.112832 (+ 90us) server_negotiation.cc:407] Connection header received
0812 06:28:06.112891 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.112892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.112905 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.112954 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.113251 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52364: BlockingRecv error: recv got EOF from 127.0.0.1:52364 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 06:28:06.146916 9743 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.146241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52368 (local address 127.30.15.125:35821)
0812 06:28:06.146288 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.146290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.146413 (+ 123us) server_negotiation.cc:407] Connection header received
0812 06:28:06.146485 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.146486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.146501 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.146545 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.146860 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52368: BlockingRecv error: recv got EOF from 127.0.0.1:52368 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260812 06:28:06.212814 9743 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.212146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52378 (local address 127.30.15.125:35821)
0812 06:28:06.212216 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.212218 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.212287 (+ 69us) server_negotiation.cc:407] Connection header received
0812 06:28:06.212359 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.212360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.212375 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.212418 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.212753 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52378: BlockingRecv error: recv got EOF from 127.0.0.1:52378 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260812 06:28:06.342465 9743 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.341843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52384 (local address 127.30.15.125:35821)
0812 06:28:06.341917 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.341919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.341991 (+ 72us) server_negotiation.cc:407] Connection header received
0812 06:28:06.342042 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.342043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.342069 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.342128 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.342410 (+ 282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52384: BlockingRecv error: recv got EOF from 127.0.0.1:52384 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260812 06:28:06.600104 9743 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:06.599555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52396 (local address 127.30.15.125:35821)
0812 06:28:06.599617 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:06.599618 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:06.599626 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:28:06.599684 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:06.599685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:06.599695 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:06.599741 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:06.600041 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52396: BlockingRecv error: recv got EOF from 127.0.0.1:52396 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260812 06:28:06.947121 9741 catalog_manager.cc:1259] Loaded cluster ID: b153d0113b0f4a1e8c5d9205a8a9a4ca
I20260812 06:28:06.947193 9741 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3: loading cluster ID for follower catalog manager: success
I20260812 06:28:06.947973 9741 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3: acquiring CA information for follower catalog manager: success
I20260812 06:28:06.948239 9741 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5c8681af2d1e4c9ca8d6668b70c399f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:28:06.966399 9767 catalog_manager.cc:1259] Loaded cluster ID: b153d0113b0f4a1e8c5d9205a8a9a4ca
I20260812 06:28:06.966456 9767 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0: loading cluster ID for follower catalog manager: success
I20260812 06:28:06.967183 9767 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0: acquiring CA information for follower catalog manager: success
I20260812 06:28:06.967442 9767 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7f03cff76ded41309462a27e6bbd62f0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:28:07.115885 9983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:07.113234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52398 (local address 127.30.15.125:35821)
0812 06:28:07.113367 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:07.113369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:07.113378 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:28:07.113406 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:07.113407 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:07.113459 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:07.113538 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:28:07.113692 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:07.114190 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:07.115046 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:07.115248 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:07.115322 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:07.115496 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:28:07.115611 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:28:07.115696 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:07.115771 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 06:28:07.115796 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260812 06:28:07.119997 9993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:07.117601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45774 (local address 127.30.15.124:40365)
0812 06:28:07.117729 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:07.117731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:07.117742 (+ 11us) server_negotiation.cc:407] Connection header received
0812 06:28:07.117795 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:07.117795 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:07.117841 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:07.117901 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:28:07.118006 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:07.118478 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:07.119182 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:07.119458 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:07.119514 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:07.119670 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:28:07.119775 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:28:07.119834 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:07.119883 (+ 49us) server_negotiation.cc:299] Negotiation successful
0812 06:28:07.119902 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":65,"threads_started":1}
I20260812 06:28:07.124094 9983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:07.121684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52402 (local address 127.30.15.125:35821)
0812 06:28:07.121727 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:07.121728 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:07.121828 (+ 100us) server_negotiation.cc:407] Connection header received
0812 06:28:07.121946 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:07.121947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:07.121957 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:07.121984 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:28:07.122139 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:07.122600 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:07.123414 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:07.123635 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:07.123671 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:07.123843 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:28:07.123871 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:28:07.123894 (+ 23us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:07.123998 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 06:28:07.124019 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260812 06:28:07.124557 9999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:07.121559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34110 (local address 127.30.15.126:40417)
0812 06:28:07.121658 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:07.121660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:07.121668 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:28:07.121710 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:07.121711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:07.121759 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:07.121836 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:28:07.122033 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:07.122541 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:07.123583 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:07.123875 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:07.123943 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:07.124162 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:28:07.124251 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:28:07.124295 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:07.124449 (+ 154us) server_negotiation.cc:299] Negotiation successful
0812 06:28:07.124474 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":47,"threads_started":1}
I20260812 06:28:07.125099 9993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:07.121942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45778 (local address 127.30.15.124:40365)
0812 06:28:07.121974 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:07.121976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:07.122008 (+ 32us) server_negotiation.cc:407] Connection header received
0812 06:28:07.122067 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:07.122068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:07.122076 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:07.122118 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:28:07.122817 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:07.123553 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:07.124529 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:07.124738 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:07.124800 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:07.124913 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:28:07.124937 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:28:07.124987 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:07.125019 (+ 32us) server_negotiation.cc:299] Negotiation successful
0812 06:28:07.125036 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:28:07.128027 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 9245
I20260812 06:28:07.143586 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 9419
I20260812 06:28:07.151212 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 9573
2026-08-12T06:28:07Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2925 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 06:28:07 dist-test-slave-gjrz krb5kdc[10010](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 06:28:07 dist-test-slave-gjrz krb5kdc[10010](info): set up 2 sockets
Aug 12 06:28:07 dist-test-slave-gjrz krb5kdc[10010](info): commencing operation
krb5kdc: starting...
W20260812 06:28:08.344709 30781 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/test-user.keytab.
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T06:28:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:28:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.15.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
Entry for principal kudu/127.30.15.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab.
I20260812 06:28:08.456103 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:41273
--webserver_interface=127.30.15.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:41273,127.30.15.125:34697,127.30.15.124:36387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 06:28:08.535161 10029 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:28:08.535368 10029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:28:08.535392 10029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:28:08.535418 10029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:28:08.536506 10029 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:28:08.536545 10029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:28:08.536563 10029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:28:08.536578 10029 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:28:08.536594 10029 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:28:08.538038 10029 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:41273,127.30.15.125:34697,127.30.15.124:36387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.126.keytab
--principal=kudu/127.30.15.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.126:41273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.15.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:28:08.538271 10029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:28:08.538461 10029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:28:08.542932 10041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:08.542954 10040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:08.542927 10047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:08.543020 10029 server_base.cc:1034] running on GCE node
I20260812 06:28:08.543437 10029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:28:08.543682 10029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:28:08.544806 10029 hybrid_clock.cc:648] HybridClock initialized: now 1786516088544796 us; error 26 us; skew 500 ppm
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:28:08.550083 10029 init.cc:377] Logged in from keytab as kudu/127.30.15.126@KRBTEST.COM (short username kudu)
I20260812 06:28:08.550474 10029 webserver.cc:460] Webserver started at http://127.30.15.126:37465/ using document root <none> and password file <none>
I20260812 06:28:08.550663 10029 fs_manager.cc:359] Metadata directory not provided
I20260812 06:28:08.550701 10029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:28:08.550787 10029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:28:08.551748 10029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/data/instance:
uuid: "92428d0bbdbc46b691fee2b408532411"
format_stamp: "Formatted at 2026-08-12 06:28:08 on dist-test-slave-gjrz"
server_key: "4f98177256e816341f4c0dca4fc40168"
server_key_iv: "a7e9e2f5ed5ade4c1b952b6ed472abe5"
server_key_version: "encryptionkey@0"
I20260812 06:28:08.552029 10029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/wal/instance:
uuid: "92428d0bbdbc46b691fee2b408532411"
format_stamp: "Formatted at 2026-08-12 06:28:08 on dist-test-slave-gjrz"
server_key: "4f98177256e816341f4c0dca4fc40168"
server_key_iv: "a7e9e2f5ed5ade4c1b952b6ed472abe5"
server_key_version: "encryptionkey@0"
I20260812 06:28:08.553200 10029 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 06:28:08.553807 10060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:28:08.553964 10029 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:28:08.554033 10029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/wal
uuid: "92428d0bbdbc46b691fee2b408532411"
format_stamp: "Formatted at 2026-08-12 06:28:08 on dist-test-slave-gjrz"
server_key: "4f98177256e816341f4c0dca4fc40168"
server_key_iv: "a7e9e2f5ed5ade4c1b952b6ed472abe5"
server_key_version: "encryptionkey@0"
I20260812 06:28:08.554098 10029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:28:08.566471 10029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:28:08.568015 10029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:28:08.568120 10029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:28:08.571785 10029 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.126:41273
I20260812 06:28:08.571818 10172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.126:41273 every 8 connection(s)
I20260812 06:28:08.572113 10029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/data/info.pb
I20260812 06:28:08.573031 10180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:28:08.574426 10180 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:28:08.580189 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 10029
I20260812 06:28:08.580288 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-0/wal/instance
I20260812 06:28:08.580492 30781 external_mini_cluster.cc:1428] Setting key 65b23d587cc23c1e356627e065ee2b42
I20260812 06:28:08.583189 10183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.575032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60470 (local address 127.30.15.126:41273)
0812 06:28:08.575167 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.575175 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.575361 (+ 186us) server_negotiation.cc:407] Connection header received
0812 06:28:08.575827 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.575829 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.575845 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.575916 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.576357 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.577181 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.577960 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.578254 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.578326 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.580050 (+ 1724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.580059 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.580060 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.580067 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.581823 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.582167 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.582170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.582170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.582269 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.582482 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.582483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.582483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.582701 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.582762 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.582957 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.583047 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
I20260812 06:28:08.583250 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.574993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41273 (local address 127.0.0.1:60470)
0812 06:28:08.575229 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.575253 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:08.575719 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:08.575928 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:08.575930 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:08.576141 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:08.576290 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.576294 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.577252 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.577252 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.577900 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.577902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.578331 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.578331 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.578382 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.578731 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:08.578738 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:08.579971 (+ 1233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:08.581905 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.581912 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.581913 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.582095 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.582329 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.582329 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.582329 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.582420 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.582763 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:08.582770 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:08.582840 (+ 70us) client_negotiation.cc:769] Sending connection context
0812 06:28:08.582931 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 06:28:08.583130 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":58,"thread_start_us":107,"threads_started":1}
I20260812 06:28:08.584561 10180 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:28:08.585426 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.584990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:34697 (local address 127.0.0.1:37318)
0812 06:28:08.585351 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.585401 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:34697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342}
W20260812 06:28:08.586249 10071 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.15.125:34697: connect: Connection refused (error 111)
I20260812 06:28:08.586764 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.586677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:34697 (local address 127.0.0.1:37326)
0812 06:28:08.586720 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.586746 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:34697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 06:28:08.586871 10180 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.125:34697: Network error: Client connection negotiation failed: client connection to 127.30.15.125:34697: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.30.15.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.125.keytab.
Entry for principal kudu/127.30.15.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.125.keytab.
I20260812 06:28:08.603776 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.125:34697
--webserver_interface=127.30.15.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.125.keytab
--principal=kudu/127.30.15.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:41273,127.30.15.125:34697,127.30.15.124:36387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:28:08.636109 10180 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } attempt: 1
I20260812 06:28:08.636544 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.636419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:34697 (local address 127.0.0.1:37336)
0812 06:28:08.636473 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.636512 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:34697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:28:08.636853 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.636777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:34697 (local address 127.0.0.1:37350)
0812 06:28:08.636813 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.636837 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:34697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 06:28:08.636950 10180 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.125:34697: Network error: Client connection negotiation failed: client connection to 127.30.15.125:34697: connect: Connection refused (error 111)
W20260812 06:28:08.683372 10194 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:28:08.683554 10194 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:28:08.683570 10194 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:28:08.683594 10194 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 06:28:08.684695 10194 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:28:08.684731 10194 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:28:08.684742 10194 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:28:08.684753 10194 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:28:08.684765 10194 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:28:08.686214 10194 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:41273,127.30.15.125:34697,127.30.15.124:36387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.125.keytab
--principal=kudu/127.30.15.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.125:34697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.15.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10194
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:28:08.686429 10194 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:28:08.686631 10194 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:28:08.691095 10204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:08.691111 10205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:08.691169 10208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:08.691303 10194 server_base.cc:1034] running on GCE node
I20260812 06:28:08.691584 10194 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:28:08.691849 10194 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:28:08.692979 10194 hybrid_clock.cc:648] HybridClock initialized: now 1786516088692964 us; error 31 us; skew 500 ppm
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:28:08.695170 10194 init.cc:377] Logged in from keytab as kudu/127.30.15.125@KRBTEST.COM (short username kudu)
I20260812 06:28:08.695603 10194 webserver.cc:460] Webserver started at http://127.30.15.125:41939/ using document root <none> and password file <none>
I20260812 06:28:08.695811 10194 fs_manager.cc:359] Metadata directory not provided
I20260812 06:28:08.695858 10194 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:28:08.695976 10194 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:28:08.696925 10194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/data/instance:
uuid: "c9ea97180b6b4f2b829daad6edd96e00"
format_stamp: "Formatted at 2026-08-12 06:28:08 on dist-test-slave-gjrz"
server_key: "7fb5f82066edaec1bc54a461f49a00eb"
server_key_iv: "8a8009e2fdf8185c81dc3a8e0d3527a8"
server_key_version: "encryptionkey@0"
I20260812 06:28:08.697232 10194 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/wal/instance:
uuid: "c9ea97180b6b4f2b829daad6edd96e00"
format_stamp: "Formatted at 2026-08-12 06:28:08 on dist-test-slave-gjrz"
server_key: "7fb5f82066edaec1bc54a461f49a00eb"
server_key_iv: "8a8009e2fdf8185c81dc3a8e0d3527a8"
server_key_version: "encryptionkey@0"
I20260812 06:28:08.698477 10194 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260812 06:28:08.699086 10221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:28:08.699231 10194 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260812 06:28:08.699330 10194 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/wal
uuid: "c9ea97180b6b4f2b829daad6edd96e00"
format_stamp: "Formatted at 2026-08-12 06:28:08 on dist-test-slave-gjrz"
server_key: "7fb5f82066edaec1bc54a461f49a00eb"
server_key_iv: "8a8009e2fdf8185c81dc3a8e0d3527a8"
server_key_version: "encryptionkey@0"
I20260812 06:28:08.699390 10194 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:28:08.705080 10180 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } attempt: 2
I20260812 06:28:08.705399 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.705293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:34697 (local address 127.0.0.1:37356)
0812 06:28:08.705343 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.705370 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:34697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 06:28:08.705674 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.705601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:34697 (local address 127.0.0.1:37368)
0812 06:28:08.705633 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.705656 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.125:34697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260812 06:28:08.705749 10180 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.125:34697: Network error: Client connection negotiation failed: client connection to 127.30.15.125:34697: connect: Connection refused (error 111)
I20260812 06:28:08.718294 10194 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:28:08.719949 10194 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:28:08.720077 10194 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:28:08.723847 10194 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.125:34697
I20260812 06:28:08.723889 10329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.125:34697 every 8 connection(s)
I20260812 06:28:08.724172 10194 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/data/info.pb
I20260812 06:28:08.725088 10330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:28:08.726526 10330 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:28:08.728133 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 10194
I20260812 06:28:08.728216 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-1/wal/instance
I20260812 06:28:08.728394 30781 external_mini_cluster.cc:1428] Setting key 559fd20a4cc784eb967e8e4bdeb02ac1
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.125@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:28:08.734901 10183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.727127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60478 (local address 127.30.15.126:41273)
0812 06:28:08.727197 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.727199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.727389 (+ 190us) server_negotiation.cc:407] Connection header received
0812 06:28:08.727845 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.727846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.727859 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.727912 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.728553 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.729174 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.730127 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.730326 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.730381 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.732395 (+ 2014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.732397 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.732397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.732405 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.733690 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.734052 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.734053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.734053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.734112 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.734320 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.734321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.734322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.734430 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.734493 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.734729 (+ 236us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.734812 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260812 06:28:08.735070 10334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.727095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41273 (local address 127.0.0.1:60478)
0812 06:28:08.727251 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.727313 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:08.727746 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:08.727986 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:08.727989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:08.728243 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:08.728462 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.728468 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.729253 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.729254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.730040 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.730042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.730409 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.730410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.730543 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.730954 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:08.730962 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:08.732299 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:08.733759 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.733765 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.733767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.733976 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.734168 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.734168 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.734169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.734262 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.734491 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:08.734498 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:08.734614 (+ 116us) client_negotiation.cc:769] Sending connection context
0812 06:28:08.734697 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 06:28:08.734840 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
I20260812 06:28:08.735656 10330 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.30.15.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.15.124@KRBTEST.COM" created.
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.125@KRBTEST.COM for kudu/127.30.15.125@KRBTEST.COM
I20260812 06:28:08.743256 10334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.735864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:34697 (local address 127.0.0.1:37374)
0812 06:28:08.736025 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.736033 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:08.736066 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:08.736222 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:08.736222 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:08.736321 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:08.736364 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.736365 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.737562 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.737563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.738072 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.738074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.738505 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.738505 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.738581 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.738868 (+ 287us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:08.738872 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:08.740725 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:08.742414 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.742415 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.742415 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.742566 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.742760 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.742761 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.742761 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.742803 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.743054 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:08.743055 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:08.743086 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 06:28:08.743129 (+ 43us) client_negotiation.cc:240] Negotiation successful
0812 06:28:08.743198 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151}
I20260812 06:28:08.743396 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.735915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37374 (local address 127.30.15.125:34697)
0812 06:28:08.736074 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.736079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.736104 (+ 25us) server_negotiation.cc:407] Connection header received
0812 06:28:08.736126 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.736129 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.736142 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.736221 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.736423 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.737441 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.738143 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.738432 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.738502 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.740800 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.740807 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.740807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.740813 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.742326 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.742637 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.742640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.742640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.742704 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.742840 (+ 136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.742840 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.742840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.742993 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.743070 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.743162 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.743259 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
I20260812 06:28:08.743976 10330 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:28:08.744264 10334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.744173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48258)
0812 06:28:08.744203 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.744242 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260812 06:28:08.744392 10226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
I20260812 06:28:08.744786 10334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.744705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48270)
0812 06:28:08.744746 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.744769 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 06:28:08.744876 10330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:36387: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.15.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.124.keytab.
Entry for principal kudu/127.30.15.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.124.keytab.
I20260812 06:28:08.754350 30781 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskS3BRRW/build/release/bin/kudu
/tmp/dist-test-taskS3BRRW/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.124:36387
--webserver_interface=127.30.15.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.124.keytab
--principal=kudu/127.30.15.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.15.84:34757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.15.126:41273,127.30.15.125:34697,127.30.15.124:36387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 06:28:08.794081 10330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } attempt: 1
I20260812 06:28:08.794605 10334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.794441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48272)
0812 06:28:08.794525 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.794571 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 06:28:08.794989 10334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.794881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48288)
0812 06:28:08.794919 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.794945 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260812 06:28:08.795085 10330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:36387: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
I20260812 06:28:08.796871 10180 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } attempt: 3
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.125@KRBTEST.COM
I20260812 06:28:08.803345 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.797194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37376 (local address 127.30.15.125:34697)
0812 06:28:08.797238 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.797240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.797250 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:28:08.797325 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.797326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.797335 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.797382 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.797706 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.798258 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.798950 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.799203 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.799282 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.800951 (+ 1669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.800952 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.800953 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.800959 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.802301 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.802615 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.802617 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.802617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.802674 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.802832 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.802834 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.802834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.802944 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.803019 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.803166 (+ 147us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.803234 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260812 06:28:08.803351 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.797136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:34697 (local address 127.0.0.1:37376)
0812 06:28:08.797197 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.797208 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:08.797257 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:08.797395 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:08.797396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:08.797565 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:08.797632 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.797634 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.798338 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.798340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.798880 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.798882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.799293 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.799294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.799370 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.799765 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:08.799770 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:08.800877 (+ 1107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:08.802372 (+ 1495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.802373 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.802374 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.802540 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.802726 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.802727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.802727 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.802784 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.803014 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:08.803015 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:08.803062 (+ 47us) client_negotiation.cc:769] Sending connection context
0812 06:28:08.803136 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:28:08.803233 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 06:28:08.803696 10180 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:28:08.803990 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.803914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48304)
0812 06:28:08.803945 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.803972 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260812 06:28:08.804301 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.804193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48320)
0812 06:28:08.804238 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.804269 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260812 06:28:08.804394 10180 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:36387: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
W20260812 06:28:08.835039 10342 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 06:28:08.835219 10342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:28:08.835235 10342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:28:08.835253 10342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 06:28:08.835521 10180 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } attempt: 1
I20260812 06:28:08.835893 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.835771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48326)
0812 06:28:08.835828 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.835864 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260812 06:28:08.836261 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.836164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48342)
0812 06:28:08.836208 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.836238 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260812 06:28:08.836347 10180 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:36387: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
W20260812 06:28:08.836572 10342 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:28:08.836608 10342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 06:28:08.836621 10342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:28:08.836637 10342 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:28:08.836648 10342 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:28:08.838027 10342 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.15.84:34757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.15.126:41273,127.30.15.125:34697,127.30.15.124:36387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/krb5kdc/kudu_127.30.15.124.keytab
--principal=kudu/127.30.15.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.15.124:36387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.15.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 05:25:39 UTC on ccycloud.quasar-efcgmt.root.comops.site
build id 4581994
I20260812 06:28:08.838222 10342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:28:08.838406 10342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 06:28:08.842801 10353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:08.842818 10356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:28:08.842816 10352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:28:08.843041 10342 server_base.cc:1034] running on GCE node
I20260812 06:28:08.843241 10342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:28:08.843497 10342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:28:08.844646 10342 hybrid_clock.cc:648] HybridClock initialized: now 1786516088844633 us; error 30 us; skew 500 ppm
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 06:28:08.846930 10342 init.cc:377] Logged in from keytab as kudu/127.30.15.124@KRBTEST.COM (short username kudu)
I20260812 06:28:08.847409 10342 webserver.cc:460] Webserver started at http://127.30.15.124:42037/ using document root <none> and password file <none>
I20260812 06:28:08.847615 10342 fs_manager.cc:359] Metadata directory not provided
I20260812 06:28:08.847661 10342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:28:08.847785 10342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:28:08.848765 10342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/data/instance:
uuid: "bd30bfb76659442590503a0edaa0cea2"
format_stamp: "Formatted at 2026-08-12 06:28:08 on dist-test-slave-gjrz"
server_key: "c19f312cdee13c59a5904b6efc3e783d"
server_key_iv: "d15a4e608a2009925b0d4b0dea708245"
server_key_version: "encryptionkey@0"
I20260812 06:28:08.849084 10342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/wal/instance:
uuid: "bd30bfb76659442590503a0edaa0cea2"
format_stamp: "Formatted at 2026-08-12 06:28:08 on dist-test-slave-gjrz"
server_key: "c19f312cdee13c59a5904b6efc3e783d"
server_key_iv: "d15a4e608a2009925b0d4b0dea708245"
server_key_version: "encryptionkey@0"
I20260812 06:28:08.850309 10342 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 06:28:08.850979 10369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 06:28:08.851140 10342 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260812 06:28:08.851220 10342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/data,/tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/wal
uuid: "bd30bfb76659442590503a0edaa0cea2"
format_stamp: "Formatted at 2026-08-12 06:28:08 on dist-test-slave-gjrz"
server_key: "c19f312cdee13c59a5904b6efc3e783d"
server_key_iv: "d15a4e608a2009925b0d4b0dea708245"
server_key_version: "encryptionkey@0"
I20260812 06:28:08.851313 10342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:28:08.863238 10330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } attempt: 2
I20260812 06:28:08.863618 10334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.863492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48356)
0812 06:28:08.863547 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.863585 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260812 06:28:08.863915 10334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.863836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48360)
0812 06:28:08.863872 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.863897 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260812 06:28:08.864012 10330 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.15.124:36387: Network error: Client connection negotiation failed: client connection to 127.30.15.124:36387: connect: Connection refused (error 111)
I20260812 06:28:08.866102 10342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 06:28:08.867689 10342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:28:08.867786 10342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:28:08.871451 10342 rpc_server.cc:307] RPC server started. Bound to: 127.30.15.124:36387
I20260812 06:28:08.871490 10467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.15.124:36387 every 8 connection(s)
I20260812 06:28:08.871867 10342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/data/info.pb
I20260812 06:28:08.872925 10468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:28:08.874359 10468 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } has no permanent_uuid. Determining permanent_uuid...
I20260812 06:28:08.878806 30781 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskS3BRRW/build/release/bin/kudu as pid 10342
I20260812 06:28:08.878904 30781 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskS3BRRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786515816548244-30781-0/minicluster-data/master-2/wal/instance
I20260812 06:28:08.879101 30781 external_mini_cluster.cc:1428] Setting key ebb51b06f4cb16738fba6144d6145217
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.124@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
I20260812 06:28:08.883388 10183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.874979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60482 (local address 127.30.15.126:41273)
0812 06:28:08.875049 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.875051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.875246 (+ 195us) server_negotiation.cc:407] Connection header received
0812 06:28:08.875739 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.875740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.875751 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.875803 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.876346 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.876975 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.878139 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.878326 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.878380 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.880686 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.880687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.880687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.880695 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.882025 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.882459 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.882459 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.882460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.882517 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.882715 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.882716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.882716 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.882843 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.882907 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.883197 (+ 290us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.883297 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 06:28:08.883533 10474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.874974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.126:41273 (local address 127.0.0.1:60482)
0812 06:28:08.875148 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.875181 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:08.875641 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:08.875860 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:08.875863 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:08.876105 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:08.876284 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.876288 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.877063 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.877064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.878065 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.878068 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.878395 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.878395 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.878497 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.878929 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:08.878939 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:08.880611 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:08.882102 (+ 1491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.882110 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.882112 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.882390 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.882569 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.882569 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.882569 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.882665 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.882901 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:08.882907 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:08.883057 (+ 150us) client_negotiation.cc:769] Sending connection context
0812 06:28:08.883167 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 06:28:08.883323 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":94,"threads_started":1}
I20260812 06:28:08.884058 10468 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.124@KRBTEST.COM
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.124@KRBTEST.COM for kudu/127.30.15.125@KRBTEST.COM
I20260812 06:28:08.888523 10477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.879438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48362 (local address 127.30.15.124:36387)
0812 06:28:08.879778 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.879782 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.879803 (+ 21us) server_negotiation.cc:407] Connection header received
0812 06:28:08.879822 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.879824 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.879842 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.879918 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.880594 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.881522 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.882395 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.882809 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.882876 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.886015 (+ 3139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.886022 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.886022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.886028 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.887456 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.887799 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.887801 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.887802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.887857 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.888020 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.888021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.888021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.888156 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.888274 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.888358 (+ 84us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.888432 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":80,"threads_started":1}
I20260812 06:28:08.890026 10474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.884276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.125:34697 (local address 127.0.0.1:37388)
0812 06:28:08.884323 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.884334 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:08.884377 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:08.884504 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:08.884505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:08.884611 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:08.884655 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.884656 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.885454 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.885454 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.885939 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.885940 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.886257 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.886258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.886332 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.886591 (+ 259us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:08.886594 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:08.887648 (+ 1054us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:08.889151 (+ 1503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.889152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.889153 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.889344 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.889503 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.889504 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.889505 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.889562 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.889757 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:08.889757 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:08.889798 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 06:28:08.889860 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:28:08.889940 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260812 06:28:08.890043 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.884336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37388 (local address 127.30.15.125:34697)
0812 06:28:08.884375 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.884377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.884386 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:28:08.884432 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.884432 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.884441 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.884489 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.884720 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.885391 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.885998 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.886192 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.886246 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.887736 (+ 1490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.887737 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.887738 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.887745 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.889090 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.889397 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.889398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.889398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.889451 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.889621 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.889622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.889622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.889709 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.889751 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.889894 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.889960 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:28:08.890442 10468 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.126@KRBTEST.COM
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.124@KRBTEST.COM for kudu/127.30.15.124@KRBTEST.COM
I20260812 06:28:08.896236 10183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.889192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60498 (local address 127.30.15.126:41273)
0812 06:28:08.889226 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.889227 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.889236 (+ 9us) server_negotiation.cc:407] Connection header received
0812 06:28:08.889274 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.889274 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.889282 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.889321 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.889823 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.890344 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.891153 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.891370 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.891417 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.893510 (+ 2093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.893511 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.893511 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.893518 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.894952 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.895284 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.895285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.895286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.895341 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.895728 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.895729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.895729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.895865 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.896040 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.896080 (+ 40us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.896154 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:28:08.896245 10474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.890650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48364)
0812 06:28:08.890687 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.890697 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:08.890730 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:08.890853 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:08.890854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:08.890954 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:08.890980 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.890981 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.891765 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.891766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.892216 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.892218 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.892643 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.892644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.892697 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.892984 (+ 287us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:08.892988 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:08.894125 (+ 1137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:08.895398 (+ 1273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.895399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.895399 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.895540 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.895692 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.895693 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.895693 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.895751 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.895973 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:08.895974 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:08.896012 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 06:28:08.896074 (+ 62us) client_negotiation.cc:240] Negotiation successful
0812 06:28:08.896157 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260812 06:28:08.896368 10477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.890692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48364 (local address 127.30.15.124:36387)
0812 06:28:08.890724 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.890725 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.890733 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:28:08.890783 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.890784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.890792 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.890850 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.891039 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.891691 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.892290 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.892575 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.892630 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.894203 (+ 1573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.894204 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.894205 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.894212 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.895333 (+ 1121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.895588 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.895589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.895589 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.895629 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.895806 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.895807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.895807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.895917 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.895972 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.896104 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.896292 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":15}
I20260812 06:28:08.897784 10468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2: Bootstrap starting.
I20260812 06:28:08.898546 10468 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2: Neither blocks nor log segments found. Creating new log.
I20260812 06:28:08.898811 10468 log.cc:824] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2: Log is configured to *not* fsync() on all Append() calls
I20260812 06:28:08.899578 10468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2: No bootstrap required, opened a new log
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.15.125@KRBTEST.COM
I20260812 06:28:08.901455 10468 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } }
I20260812 06:28:08.901600 10468 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd30bfb76659442590503a0edaa0cea2, State: Initialized, Role: FOLLOWER
I20260812 06:28:08.901741 10468 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } }
I20260812 06:28:08.902073 10468 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:28:08.902079 10481 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } } }
I20260812 06:28:08.902208 10481 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:28:08.903518 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.896850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37390 (local address 127.30.15.125:34697)
0812 06:28:08.896881 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.896883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.896889 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:28:08.896910 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.896911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.896919 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.896960 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.897446 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.897872 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.898461 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.898703 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.898756 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.900953 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.900954 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.900955 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.900961 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.902372 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.902794 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.902795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.902795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.902854 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.903048 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.903048 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.903049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.903165 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.903337 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.903374 (+ 37us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.903437 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
W20260812 06:28:08.903983 10503 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:28:08.904080 10503 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:28:08.904835 30781 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 06:28:08.904284 10342 master_runner.cc:186] Error getting master registration for 127.30.15.126:41273: OK, instance_id { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" instance_seqno: 1786516088570717 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:28:08.906472 10342 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 06:28:08.905908 10121 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "92428d0bbdbc46b691fee2b408532411"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60498
I20260812 06:28:08.911463 10180 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } attempt: 2
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.126@KRBTEST.COM for kudu/127.30.15.124@KRBTEST.COM
I20260812 06:28:08.917721 10477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.911755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48380 (local address 127.30.15.124:36387)
0812 06:28:08.911810 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.911812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.911842 (+ 30us) server_negotiation.cc:407] Connection header received
0812 06:28:08.911860 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.911861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.911870 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.911913 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.912147 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.912819 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.913398 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.913710 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.913780 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.915614 (+ 1834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.915615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.915616 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.915622 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.916796 (+ 1174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.917133 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.917134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.917134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.917176 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.917333 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.917333 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.917333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.917436 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.917476 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.917618 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.917669 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260812 06:28:08.917779 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.911697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48380)
0812 06:28:08.911753 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.911764 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:08.911807 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:08.911927 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:08.911928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:08.912054 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:08.912087 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.912088 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.912885 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.912886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.913346 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.913347 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.913827 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.913828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.913889 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.914274 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:08.914279 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:08.915507 (+ 1228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:08.916864 (+ 1357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.916865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.916865 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.917071 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.917223 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.917224 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.917224 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.917280 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.917486 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:08.917487 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:08.917528 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 06:28:08.917602 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 06:28:08.917686 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260812 06:28:08.918998 10180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411: Bootstrap starting.
I20260812 06:28:08.919723 10180 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411: Neither blocks nor log segments found. Creating new log.
I20260812 06:28:08.920009 10180 log.cc:824] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411: Log is configured to *not* fsync() on all Append() calls
I20260812 06:28:08.920667 10180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411: No bootstrap required, opened a new log
I20260812 06:28:08.921659 10180 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } }
I20260812 06:28:08.921764 10180 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92428d0bbdbc46b691fee2b408532411, State: Initialized, Role: FOLLOWER
I20260812 06:28:08.921835 10180 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } }
I20260812 06:28:08.922152 10180 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:28:08.922125 10506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } } }
I20260812 06:28:08.922209 10506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:28:08.922277 10121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 06:28:08.922343 10121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:28:08.923108 10121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } }
I20260812 06:28:08.923595 10121 leader_election.cc:288] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [CANDIDATE]: Term 1 election: Requested vote from peers c9ea97180b6b4f2b829daad6edd96e00 (127.30.15.125:34697), bd30bfb76659442590503a0edaa0cea2 (127.30.15.124:36387)
I20260812 06:28:08.923781 10411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92428d0bbdbc46b691fee2b408532411" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "bd30bfb76659442590503a0edaa0cea2"
I20260812 06:28:08.923902 10411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:28:08.924782 10411 raft_consensus.cc:2454] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92428d0bbdbc46b691fee2b408532411 in term 1.
I20260812 06:28:08.924981 10073 leader_election.cc:302] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92428d0bbdbc46b691fee2b408532411, bd30bfb76659442590503a0edaa0cea2; no voters:
I20260812 06:28:08.925114 10506 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:28:08.925293 10506 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [term 1 LEADER]: Becoming Leader. State: Replica: 92428d0bbdbc46b691fee2b408532411, State: Running, Role: LEADER
I20260812 06:28:08.925379 10506 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } }
I20260812 06:28:08.926087 10535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92428d0bbdbc46b691fee2b408532411. Latest consensus state: current_term: 1 leader_uuid: "92428d0bbdbc46b691fee2b408532411" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } } }
I20260812 06:28:08.926788 10535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [sys.catalog]: This master's current role is: LEADER
I20260812 06:28:08.924821 10029 master_runner.cc:186] Error getting master registration for 127.30.15.125:34697: OK, instance_id { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" instance_seqno: 1786516088722752 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 06:28:08.927412 10029 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 06:28:08.927896 10528 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:28:08.927986 10528 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:28:08.930663 10549 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 06:28:08.930842 10549 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 06:28:08.936969 10183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.926380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60502 (local address 127.30.15.126:41273)
0812 06:28:08.926416 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.926417 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.927137 (+ 720us) server_negotiation.cc:407] Connection header received
0812 06:28:08.927328 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.927329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.927340 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.927384 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.928437 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.929120 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.930588 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.930870 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.930912 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.933017 (+ 2105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.933019 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.933019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.933026 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.934601 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.935302 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.935304 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.935304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.935364 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.936364 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.936365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.936365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.936511 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.936596 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.936811 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.936886 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:28:08.939564 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.926312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37402 (local address 127.30.15.125:34697)
0812 06:28:08.926364 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.926366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.929804 (+ 3438us) server_negotiation.cc:407] Connection header received
0812 06:28:08.929891 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.929892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.929901 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.929928 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.931345 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.932050 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.933990 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.934813 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.934857 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.936680 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.936681 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.936681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.936688 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.938369 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.938752 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.938753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.938754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.938808 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.938985 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.938986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.938986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.939102 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.939173 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.939385 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.939462 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260812 06:28:08.940644 10477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.926706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48394 (local address 127.30.15.124:36387)
0812 06:28:08.926736 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.926738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.927180 (+ 442us) server_negotiation.cc:407] Connection header received
0812 06:28:08.927301 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.927302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.927312 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.927340 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.928011 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.928719 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.933048 (+ 4329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.933371 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.933408 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.937408 (+ 4000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.937410 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.937410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.937417 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.938998 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.939620 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.939621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.939621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.939694 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.940000 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.940002 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.940002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.940142 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.940216 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.940482 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.940557 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260812 06:28:08.944056 10411 raft_consensus.cc:1261] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [term 1 FOLLOWER]: Refusing update from remote peer 92428d0bbdbc46b691fee2b408532411: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:28:08.944368 10535 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:28:08.945979 10481 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92428d0bbdbc46b691fee2b408532411. Latest consensus state: current_term: 1 leader_uuid: "92428d0bbdbc46b691fee2b408532411" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } } }
I20260812 06:28:08.946058 10481 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:28:08.947374 10535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "92428d0bbdbc46b691fee2b408532411" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } } }
I20260812 06:28:08.947451 10535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [sys.catalog]: This master's current role is: LEADER
I20260812 06:28:08.947732 10549 catalog_manager.cc:1347] Generated new cluster ID: 26bbaa40fd004fffa91bf0ed0da10d93
I20260812 06:28:08.947777 10549 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 06:28:08.947892 10481 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "92428d0bbdbc46b691fee2b408532411" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } } }
I20260812 06:28:08.947975 10481 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:28:08.950574 10553 mvcc.cc:205] Tried to move back new op lower bound from 7317569900312616960 to 7317569900239077376. Current Snapshot: MvccSnapshot[applied={T|T < 7317569900312616960}]
I20260812 06:28:08.955156 10330 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } attempt: 3
Aug 12 06:28:08 dist-test-slave-gjrz krb5kdc[10010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786516088, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.15.125@KRBTEST.COM for kudu/127.30.15.124@KRBTEST.COM
I20260812 06:28:08.962857 10334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.955440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.15.124:36387 (local address 127.0.0.1:48406)
0812 06:28:08.955512 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0812 06:28:08.955521 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0812 06:28:08.955564 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 06:28:08.955767 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 06:28:08.955768 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 06:28:08.955916 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0812 06:28:08.955958 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.955960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.956867 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.956868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.957679 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 06:28:08.957682 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.958209 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.958210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 06:28:08.958279 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.958689 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 06:28:08.958694 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 06:28:08.960218 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 06:28:08.961828 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.961829 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.961830 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.962051 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.962255 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 06:28:08.962256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 06:28:08.962256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0812 06:28:08.962315 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 06:28:08.962567 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 06:28:08.962568 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 06:28:08.962611 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 06:28:08.962674 (+ 63us) client_negotiation.cc:240] Negotiation successful
0812 06:28:08.962763 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260812 06:28:08.962878 10477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:08.955626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48406 (local address 127.30.15.124:36387)
0812 06:28:08.955659 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:08.955660 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:08.955666 (+ 6us) server_negotiation.cc:407] Connection header received
0812 06:28:08.955683 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:08.955684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:08.955691 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:08.955731 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:08.956035 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.956755 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.957795 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:08.958091 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:08.958148 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:08.960291 (+ 2143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 06:28:08.960293 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 06:28:08.960293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 06:28:08.960299 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0812 06:28:08.961753 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.962121 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.962122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.962122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.962191 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 06:28:08.962384 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 06:28:08.962384 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 06:28:08.962385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 06:28:08.962506 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 06:28:08.962576 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:08.962706 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 06:28:08.962793 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260812 06:28:08.964756 10330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00: Bootstrap starting.
I20260812 06:28:08.965451 10330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00: Neither blocks nor log segments found. Creating new log.
I20260812 06:28:08.965745 10330 log.cc:824] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00: Log is configured to *not* fsync() on all Append() calls
I20260812 06:28:08.966672 10330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00: No bootstrap required, opened a new log
I20260812 06:28:08.968695 10330 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } }
I20260812 06:28:08.968816 10330 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ea97180b6b4f2b829daad6edd96e00, State: Initialized, Role: FOLLOWER
I20260812 06:28:08.968883 10330 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } }
I20260812 06:28:08.969169 10330 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:28:08.969238 10271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:28:08.970050 10271 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [term 1 FOLLOWER]: Refusing update from remote peer 92428d0bbdbc46b691fee2b408532411: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:28:08.970333 10556 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 06:28:08.970644 10228 tablet.cc:2369] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:28:08.971146 10272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92428d0bbdbc46b691fee2b408532411" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c9ea97180b6b4f2b829daad6edd96e00"
I20260812 06:28:08.975356 10563 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92428d0bbdbc46b691fee2b408532411" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } } }
I20260812 06:28:08.975451 10563 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:28:08.975504 10563 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92428d0bbdbc46b691fee2b408532411. Latest consensus state: current_term: 1 leader_uuid: "92428d0bbdbc46b691fee2b408532411" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } } }
I20260812 06:28:08.975554 10563 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:28:08.975584 10563 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "92428d0bbdbc46b691fee2b408532411" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } } }
I20260812 06:28:08.975620 10563 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 06:28:08.979817 10272 raft_consensus.cc:2396] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92428d0bbdbc46b691fee2b408532411 for term 1 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260812 06:28:08.979809 10589 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 06:28:08.980368 10589 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 06:28:08.980365 10591 mvcc.cc:205] Tried to move back new op lower bound from 7317569900312616960 to 7317569900239077376. Current Snapshot: MvccSnapshot[applied={T|T < 7317569900312616960}]
I20260812 06:28:08.989899 10535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "92428d0bbdbc46b691fee2b408532411" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92428d0bbdbc46b691fee2b408532411" member_type: VOTER last_known_addr { host: "127.30.15.126" port: 41273 } } peers { permanent_uuid: "c9ea97180b6b4f2b829daad6edd96e00" member_type: VOTER last_known_addr { host: "127.30.15.125" port: 34697 } } peers { permanent_uuid: "bd30bfb76659442590503a0edaa0cea2" member_type: VOTER last_known_addr { host: "127.30.15.124" port: 36387 } } }
I20260812 06:28:08.989995 10535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411 [sys.catalog]: This master's current role is: LEADER
I20260812 06:28:08.991333 10549 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 06:28:08.992038 10549 catalog_manager.cc:1504] Loading token signing keys...
I20260812 06:28:08.996068 10549 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92428d0bbdbc46b691fee2b408532411: Generated new TSK 0
I20260812 06:28:08.996217 10549 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 06:28:09.031770 10183 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.030115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60518 (local address 127.30.15.126:41273)
0812 06:28:09.030158 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.030160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.031105 (+ 945us) server_negotiation.cc:407] Connection header received
0812 06:28:09.031207 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.031208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.031219 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.031248 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.031703 (+ 455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60518: BlockingRecv error: recv got EOF from 127.0.0.1:60518 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260812 06:28:09.032843 10477 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.030449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48420 (local address 127.30.15.124:36387)
0812 06:28:09.030487 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.030489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.032129 (+ 1640us) server_negotiation.cc:407] Connection header received
0812 06:28:09.032352 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.032353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.032363 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.032391 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.032785 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48420: BlockingRecv error: recv got EOF from 127.0.0.1:48420 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 06:28:09.033492 10337 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.030811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37404 (local address 127.30.15.125:34697)
0812 06:28:09.030849 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.030850 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.032306 (+ 1456us) server_negotiation.cc:407] Connection header received
0812 06:28:09.033112 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.033113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.033125 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.033152 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.033438 (+ 286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37404: BlockingRecv error: recv got EOF from 127.0.0.1:37404 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 06:28:09.035853 10337 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.035088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37412 (local address 127.30.15.125:34697)
0812 06:28:09.035131 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.035133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.035355 (+ 222us) server_negotiation.cc:407] Connection header received
0812 06:28:09.035458 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.035459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.035476 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.035505 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.035812 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37412: BlockingRecv error: recv got EOF from 127.0.0.1:37412 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 06:28:09.038818 10337 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.038117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37426 (local address 127.30.15.125:34697)
0812 06:28:09.038149 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.038150 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.038364 (+ 214us) server_negotiation.cc:407] Connection header received
0812 06:28:09.038447 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.038448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.038457 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.038483 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.038779 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37426: BlockingRecv error: recv got EOF from 127.0.0.1:37426 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 06:28:09.042649 10337 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.041948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37438 (local address 127.30.15.125:34697)
0812 06:28:09.041981 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.041982 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.042193 (+ 211us) server_negotiation.cc:407] Connection header received
0812 06:28:09.042278 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.042279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.042288 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.042312 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.042609 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37438: BlockingRecv error: recv got EOF from 127.0.0.1:37438 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260812 06:28:09.048538 10337 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.047807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37450 (local address 127.30.15.125:34697)
0812 06:28:09.047838 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.047840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.048059 (+ 219us) server_negotiation.cc:407] Connection header received
0812 06:28:09.048158 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.048159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.048169 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.048195 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.048499 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37450: BlockingRecv error: recv got EOF from 127.0.0.1:37450 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 06:28:09.058488 10337 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.057784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37454 (local address 127.30.15.125:34697)
0812 06:28:09.057815 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.057816 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.058033 (+ 217us) server_negotiation.cc:407] Connection header received
0812 06:28:09.058120 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.058121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.058131 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.058156 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.058449 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37454: BlockingRecv error: recv got EOF from 127.0.0.1:37454 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260812 06:28:09.076252 10337 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.075675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37468 (local address 127.30.15.125:34697)
0812 06:28:09.075711 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.075713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.075810 (+ 97us) server_negotiation.cc:407] Connection header received
0812 06:28:09.075855 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.075856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.075866 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.075913 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.076203 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37468: BlockingRecv error: recv got EOF from 127.0.0.1:37468 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260812 06:28:09.109863 10337 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.109216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37480 (local address 127.30.15.125:34697)
0812 06:28:09.109257 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.109259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.109341 (+ 82us) server_negotiation.cc:407] Connection header received
0812 06:28:09.109418 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.109419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.109427 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.109474 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.109808 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37480: BlockingRecv error: recv got EOF from 127.0.0.1:37480 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260812 06:28:09.175727 10337 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.175061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37496 (local address 127.30.15.125:34697)
0812 06:28:09.175114 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.175116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.175234 (+ 118us) server_negotiation.cc:407] Connection header received
0812 06:28:09.175320 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.175322 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.175332 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.175389 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.175679 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37496: BlockingRecv error: recv got EOF from 127.0.0.1:37496 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260812 06:28:09.305505 10337 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.304814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37510 (local address 127.30.15.125:34697)
0812 06:28:09.304878 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.304880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.304990 (+ 110us) server_negotiation.cc:407] Connection header received
0812 06:28:09.305044 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.305045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.305058 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.305116 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.305444 (+ 328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37510: BlockingRecv error: recv got EOF from 127.0.0.1:37510 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260812 06:28:09.563196 10337 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 06:28:09.562682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37526 (local address 127.30.15.125:34697)
0812 06:28:09.562740 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:09.562742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:09.562780 (+ 38us) server_negotiation.cc:407] Connection header received
0812 06:28:09.562810 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:09.562811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:09.562821 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:09.562865 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0812 06:28:09.563144 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37526: BlockingRecv error: recv got EOF from 127.0.0.1:37526 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260812 06:28:09.904549 10503 catalog_manager.cc:1259] Loaded cluster ID: 26bbaa40fd004fffa91bf0ed0da10d93
I20260812 06:28:09.904616 10503 catalog_manager.cc:1552] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2: loading cluster ID for follower catalog manager: success
I20260812 06:28:09.905382 10503 catalog_manager.cc:1574] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2: acquiring CA information for follower catalog manager: success
I20260812 06:28:09.905632 10503 catalog_manager.cc:1602] T 00000000000000000000000000000000 P bd30bfb76659442590503a0edaa0cea2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:28:09.980808 10589 catalog_manager.cc:1259] Loaded cluster ID: 26bbaa40fd004fffa91bf0ed0da10d93
I20260812 06:28:09.980883 10589 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00: loading cluster ID for follower catalog manager: success
I20260812 06:28:09.981693 10589 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00: acquiring CA information for follower catalog manager: success
I20260812 06:28:09.982007 10589 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c9ea97180b6b4f2b829daad6edd96e00: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 06:28:10.078732 10744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:10.076379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34212 (local address 127.30.15.125:34697)
0812 06:28:10.076518 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:10.076520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:10.076530 (+ 10us) server_negotiation.cc:407] Connection header received
0812 06:28:10.076613 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:10.076614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:10.076669 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:10.076733 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:28:10.076862 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:10.077357 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:10.078098 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:10.078281 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:10.078323 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:10.078441 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:28:10.078550 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:28:10.078602 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:10.078628 (+ 26us) server_negotiation.cc:299] Negotiation successful
0812 06:28:10.078645 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":73,"threads_started":1}
I20260812 06:28:10.082386 10758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:10.080413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54250 (local address 127.30.15.124:36387)
0812 06:28:10.080525 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:10.080527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:10.080534 (+ 7us) server_negotiation.cc:407] Connection header received
0812 06:28:10.080579 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:10.080580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:10.080616 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:10.080676 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:28:10.080752 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:10.081217 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:10.081845 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:10.082034 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:10.082081 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:10.082171 (+ 90us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:28:10.082255 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:28:10.082299 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:10.082315 (+ 16us) server_negotiation.cc:299] Negotiation successful
0812 06:28:10.082329 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":56,"threads_started":1}
I20260812 06:28:10.086350 10758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:10.084014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54252 (local address 127.30.15.124:36387)
0812 06:28:10.084046 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:10.084047 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:10.084137 (+ 90us) server_negotiation.cc:407] Connection header received
0812 06:28:10.084202 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:10.084203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:10.084213 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:10.084255 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:28:10.084389 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:10.084830 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:10.085747 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:10.085946 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:10.086034 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:10.086147 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:28:10.086175 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:28:10.086217 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:10.086267 (+ 50us) server_negotiation.cc:299] Negotiation successful
0812 06:28:10.086286 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260812 06:28:10.086706 10744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:10.083853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34216 (local address 127.30.15.125:34697)
0812 06:28:10.083945 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:10.083947 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:10.084097 (+ 150us) server_negotiation.cc:407] Connection header received
0812 06:28:10.084194 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:10.084195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:10.084204 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:10.084229 (+ 25us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:28:10.084372 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:10.085083 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:10.085977 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:10.086256 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:10.086310 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:10.086493 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:28:10.086526 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:28:10.086569 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:10.086622 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 06:28:10.086640 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 06:28:10.087548 10766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 06:28:10.083843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49508 (local address 127.30.15.126:41273)
0812 06:28:10.083992 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0812 06:28:10.083994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0812 06:28:10.084002 (+ 8us) server_negotiation.cc:407] Connection header received
0812 06:28:10.084052 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 06:28:10.084053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 06:28:10.084099 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 06:28:10.084168 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 06:28:10.084312 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:10.085087 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:10.086789 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 06:28:10.087089 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 06:28:10.087151 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 06:28:10.087291 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 06:28:10.087384 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 06:28:10.087435 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 06:28:10.087469 (+ 34us) server_negotiation.cc:299] Negotiation successful
0812 06:28:10.087491 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":60,"threads_started":1}
I20260812 06:28:10.089243 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 10029
I20260812 06:28:10.110497 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 10194
I20260812 06:28:10.119364 30781 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskS3BRRW/build/release/bin/kudu with pid 10342
2026-08-12T06:28:10Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2966 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5892 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (273582 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST